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Preface 


Promotion  and  separation  from  military  service  have  been  intertwined 
for  the  entire  history  of  the  officer  corps  of  the  United  States,  but  cause 
and  effect  have  changed  over  time.  Aside  from  periods  of  downsiz¬ 
ing,  the  separation  of  some  officers  has  always  led  to  the  promotion 
of  others.  Through  World  War  II  involuntary  separation  for  age  and 
tenure  was  seldom  mandatory  and  promotion  was  based  on  seniority. 
As  a  result  promotions  were  few  in  periods  of  peace;  periods  of  war  or 
expansion  led  to  more  and  faster  promotions.  In  1947  the  policies  for 
promoting  and  separating  officers  changed  significantly  with  the  im¬ 
plementation  of  an  “up-or-out”  system  in  all  services.  With  up-or-out 
statutory  boards  replaced  seniority  as  the  means  for  selecting  officers 
for  promotion.  These  statutory  boards  also  became  a  means  of  forcing 
the  separation  or  retirement  of  officers  not  selected  for  promotion. 

The  promotion-separation  systems  before  and  after  1 947  both  ap¬ 
plied  one-size-fits-all  rules  to  the  entire  officer  corps.  With  a  seniority 
system  everyone  who  does  not  separate  or  retire  is  eventually  promoted; 
with  an  up-or-out  system  everyone  who  is  not  promoted  has  to  sepa¬ 
rate  or  retire.  The  services  can  make  exceptions  to  the  up-or-out  rule 
by  selectively  continuing  certain  officers,  but  selective  continuation 
(SELCON)  exists  to  add  a  few  years  to  the  end  of  an  officers  career, 
not  to  enable  prospective  career  planning  for  an  entire  community. 
The  lack  of  flexibility  afforded  by  an  up-or-out  system  is  one  argument 
for  exploring  the  implementation  and  outcomes  of  alternative  policies. 
In  an  age  of  increasing  specialization,  the  officer  corps  has  a  number 
of  technical  and  functional  communities  for  whom  more  flexible 
promotion-separation  systems  may  be  appropriate.  Any  alternative 
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must  still  have  mechanisms  for  separating  officers  who  are  not  vigor¬ 
ous,  capable,  and  performing  well  and  for  promoting  officers  who  are. 

“Up-or-stay”  is  often  adopted  as  a  shorthand  means  of  describing 
alternative  systems.  More  properly,  they  might  be  termed  alternative  ca¬ 
reer  paths  because  a  wider  range  of  career  outcomes,  desirable  to  both 
individual  officers  and  military  organizations,  could  eventuate  if  less 
uniformity  existed.  The  one-size-fits-all  command  path  alternative  tied 
to  existing  promotion-flow  separation  or  retirement  is  seen  as  creating 
limits  to  military  effectiveness.  But  what  are  the  alternatives  that  might 
be  considered? 

In  2002,  the  Under  Secretary  of  Defense  for  Personnel  and  Readiness 
(USD[P&R])  asked  the  secretaries  of  the  military  departments  to  suggest 
officer  communities  in  which  changed  policies  might  be  tested.  The  RAND 
Corporation  was  simultaneously  asked  to  oudine  policies  that  might  be 
tested,  to  suggest  how  such  tests  might  be  evaluated,  and  to  work  with  the 
military  services  in  applying  policies  to  communities  as  the  basis  for  tests. 
The  demonstration  projects  suggested  here  and  the  means  of  evaluating 
them  are  results  of  our  research.  These  projects  have  not  been  formally  ap¬ 
proved  or  coordinated  within  the  Department  of  Defense  (DoD).  More¬ 
over,  legislative  authority  is  needed  to  conduct  such  tests.  This  report  serves 
as  a  basis  for  seeking  needed  authority  and  for  defining  specific  demonstra¬ 
tion  projects  with  the  services.  As  such  the  report  should  be  of  interest  to 
military  personnel  managers  in  all  of  the  services. 

This  research  was  conducted  for  the  Office  of  the  Deputy  Assis¬ 
tant  Secretary  of  Defense  (Military  Personnel  Policy)  within  the  Forces 
and  Resources  Policy  Center  of  the  RAND  National  Defense  Research 
Institute  (NDRI),  a  division  of  the  RAND  Corporation  and  a  feder¬ 
ally  funded  research  and  development  center  sponsored  by  the  Office 
of  the  Secretary  of  Defense  (OSD),  the  Joint  Staff,  the  unified  com¬ 
mands,  and  the  defense  agencies. 

Comments  are  welcome  and  may  be  addressed  to  the  project  leader, 
Peter  Schirmer  (Peter_Schirmer@rand.org).  For  more  information  on 
RAND’s  Forces  and  Resources  Policy  Center,  contact  the  director,  Susan 
Everingham,  Susan_Everingham@rand.org,  310-393-0411,  extension 
7654.  RAND  Corporation,  Main  Street,  Santa  Monica,  California  90401. 
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Peer  review  is  an  integral  part  of  all  RAND  research  projects.  Prior  to 
publication,  this  document,  as  with  all  documents  in  the  RAND 
monograph  series,  was  subject  to  a  quality  assurance  process  to  ensure 
that  the  research  meets  several  standards,  including  the  following: 
The  problem  is  well  formulated;  the  research  approach  is  well 
designed  and  well  executed;  the  data  and  assumptions  are  sound;  the 
findings  are  useful  and  advance  knowledge;  the  implications  and  rec¬ 
ommendations  follow  logically  from  the  findings  and  are  explained 
thoroughly;  the  documentation  is  accurate,  understandable,  cogent, 
and  temperate  in  tone;  the  research  demonstrates  understanding  of 
related  previous  studies;  and  the  research  is  relevant,  objective,  inde¬ 
pendent,  and  balanced.  Peer  review  is  conducted  by  research  profes¬ 
sionals  who  were  not  members  of  the  project  team. 

RAND  routinely  reviews  and  refines  its  quality  assurance  proc¬ 
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Summary 


Background 

In  recent  years,  DoD  has  increasingly  focused  on  creating  a  more  strategic, 
modernized,  and  flexible  officer  personnel  system — in  particular,  a  system 
that  will  leverage  its  human  capital  to  improve  organizational  effectiveness 
while  enhancing  the  quality  of  life  of  its  officers.  To  achieve  these  goals, 
DoD  is  exploring  a  wide  range  of  personnel  management  programs  that 
promise  to  offer  enhanced  stability  and  flexibility  for  service  members 
while  also  placing  greater  value  on  experience  and  maturity. 

One  area  that  has  received  considerable  attention  is  the  military’s 
promotion  system.  Secretary  of  Defense  Donald  Rumsfeld  has  expressed 
concern  that  current  promotion  policies  risk  driving  experienced  people 
to  leave  the  military  too  early.  Echoing  these  comments,  Admiral  David 
Jeremiah,  the  head  of  the  secretary’s  Morale  and  Quality  of  Life  Review 
Panel,  has  noted,  “We  make  it  hard  for  people  to  stay.” 

At  present,  almost  all  military  officers  are  subject  to  a  policy  com¬ 
monly  known  as  up-or-out,  which  requires  separation  from  service  if 
an  officer  is  not  promoted  within  a  certain  period  of  time  (or  selectively 
continued)  or  when  an  officer  encounters  established  grade  tenure  lim¬ 
its.  Of  late,  the  possibility  of  eliminating  or  modifying  up-or-out  has 
been  a  source  of  growing  debate.  In  order  to  consider  the  issue  more 
fully,  the  USD(P&R)  asked  NDRI  to  design  and  determine  the  effec¬ 
tiveness  of  new  career  path  alternatives.  Specifically,  we  were  asked  to 
recommend  alternatives  to  up-or-out  that  could  be  implemented  on  a 
limited  basis  as  demonstration  projects  and  then  evaluated  for  possible 
wider  implementation. 
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Up-or-Out  or  Up-or-Stay? 

The  military’s  up-or-out  policy  mandates  that  officers  who  are  twice 
failed  of  selection  for  promotion  within  a  single  grade  be  discharged, 
retired,  or  at  best  allowed  to  serve  up  to  two  more  years  in  order  to 
qualify  for  retirement.  The  up-or-out  policy  is  intended  to  provide  a 
strong  incentive  for  good  performance,  create  promotion  opportuni¬ 
ties  for  officers  in  lower  grades,  and  lower  the  average  age  of  the  officer 
corps.  Such  a  policy  implicitly  defines  “success”  by  promotion. 

The  up-or-out  policy,  formalized  in  federal  law  in  1947,  re¬ 
placed  a  strict  seniority  system  that  many  saw  as  inhibiting  military 
readiness  at  the  start  of  World  War  II.  Since  its  inception  critics  have 
said  the  policy  is  wasteful,  results  in  senior  officers  feeling  their  expe¬ 
rience  is  not  valued,  causes  officers  to  move  through  assignments  too 
quickly,  and  reduces  the  experience  level  of  the  officer  corps.  Instead 
of  an  up-or-out  policy,  many  private  and  public  sector  organizations, 
as  well  as  some  foreign  militaries,  have  up-or-stay  policies  that  allow 
individuals  to  enjoy  full  careers  even  if  they  do  not  advance  beyond 
certain  positions  or  levels.  This  policy,  which  does  not  entirely  pre¬ 
clude  forced  separation,  offers  lower  turnover,  greater  career  stabil¬ 
ity,  a  more  experienced  workforce,  and  possibly  reduced  numbers 
of  accessions  and  reduced  training  costs.  If  achieved,  such  outcomes 
would  advance  DoD’s  efforts  to  create  more  stable  career  paths  for 
its  officers. 


Formulating  Alternatives  to  Up-or-Out 

In  order  to  help  DoD  consider  alternatives  to  up-or-out,  we  considered 
a  range  of  potential  substitutes  for,  or  modifications  of,  existing  policy. 
The  simplest  option  is  to  eliminate  up-or-out  entirely  or  to  limit  it 
to  junior-grade  officers.  We  also  studied  various  policies  that  would 
not  abolish  the  principle  of  up-or-out  but  would  still  achieve  some  of 
the  same  goals  as  an  up-or-stay  policy,  such  as  broadening  promotion 
zones  (e.g.,  allowing  promotion  consideration  over  a  five-year  period) 
or  allowing  officers  to  choose  when  they  are  considered  for  promo- 
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tion  within  time-in-grade  milestones  and  other  constraints  set  by  the 
services. 

Because  changing  a  single  policy  can  have  repercussions  through¬ 
out  the  career  management  system,  we  also  suggest  related  policies  that 
could,  or  should,  change  if  up-or-out  is  modified.  For  instance,  the 
services  will  require  a  refined  mechanism  for  involuntary  separation  of 
nonperforming  officers.  Assignment  policies  might  also  change  if  offi¬ 
cers  stay  in  service  without  requirement  of  promotion,  and  new  career 
paths  may  emerge — such  as  a  “fly  only”  option  for  pilots. 

Compensation  and  incentives  would  also  be  affected  by  up-or-out 
alternatives.  With  replacement  of  up-or-out,  average  time  in  grade  is 
likely  to  increase  at  certain  grades,  as  will  cumulative  years  of  service 
(YOS).  More  officers  will  reach  the  point  where  they  are  no  longer  eli¬ 
gible  for  longevity  pay  increases  based  on  the  present  pay  tables.  Thus,  we 
considered  various  ways  to  compensate  officers  during  a  demonstration 
project  through  existing  incentives,  for  example,  critical  skills  retention 
bonuses  (CSRBs)  and  the  Thrift  Savings  Plan  (TSP),  which  could  be 
used  to  boost  officer  remuneration.  Further,  in  creating  proposed  alter¬ 
natives  for  demonstration  projects,  we  considered  nonmonetary  incen¬ 
tives,  especially  geographic  stability,  in  addition  to  monetary  incentives. 
All  of  these  related  policies  played  a  role  in  the  final  formulation  of  our 
proposed  programs  and  their  target  populations. 


Determining  Target  Communities 

Within  the  military’s  warfighting  communities  there  is  a  long-held  be¬ 
lief  that  up-or-out  ensures  the  vitality  of  the  force.  Given  this  tradition 
and  a  general  skepticism  about  ending  such  an  established  policy,  it 
was  a  challenge  identifying  communities  to  participate  in  these  dem¬ 
onstration  projects.  In  general,  officer  community  managers  resist  end¬ 
ing  up-or-out,  except  for  the  medical  and  legal  communities  and  for 
certain  technical  specialists,  such  as  members  of  the  acquisition  corps. 
Those  warfighting  communities  that  were  more  open  to  the  idea  of  an 
alternative  to  up-or-out  currently  face  manning  problems  they  wish 
to  resolve.  As  a  result,  two  of  our  policy  packages  for  testing  attempt 
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to  address  manning  shortages.  The  risk  of  such  a  strategy  is  that  an 
up-or-stay  program  is  viewed  merely  as  a  temporary  fix  to  a  transitory 
problem,  obscuring  the  benefits  of  implementing  it  as  a  more  perma¬ 
nent  policy.  We  therefore  offer  two  other  policy  packages  that  explore 
other  benefits  of  an  up-or-stay  system:  greater  flexibility  in  managing 
the  careers  of  highly  valued  officers  and  increased  return  on  investment 
in  training  and  education. 

Although  we  have  tailored  the  packages  for  a  demonstration  proj¬ 
ect  to  particular  communities,  they  can  be  adapted  to  other  communi¬ 
ties  and  even  to  other  services.  Specifically,  we  formulated  four  up-or- 
stay  policy  packages  focused  on  four  communities  of  different  sizes: 

•  Air  Force:  individuals  in  multiple  communities 

•  Army:  the  entire  foreign  area  officer  (FAO)  community. 

•  Navy:  individuals  in  the  Surface  Warfare  Officer  (SWO)  commu¬ 
nity 

•  Marine  Corps:  individuals  across  the  entire  corps 

Our  Approach 

These  four  proposed  programs  (or  alternatives  to  them)  would  be  im¬ 
plemented  as  demonstration  projects.  Federal  agencies  have  carried  out 
a  number  of  such  projects  to  test  prospective  changes  in  the  civilian 
personnel  management  system.  On  the  military  side,  the  practice  is  far 
less  common  but  has  the  potential  to  become  a  critical  new  tool  for 
military  personnel  planning  as  well. 

The  design  of  our  projects  varies  based  on  the  size  of  the  pro¬ 
gram  and  the  participant  selection  strategy  (i.e.,  whether  participants 
are  selected  randomly  or  are  chosen  based  on  specific  characteristics). 
We  propose  that  one  project — the  Air  Force  program — could  be  con¬ 
ducted  as  a  controlled  field  experiment.  Such  a  design  is  possible  with 
a  program  of  this  size,  and  random  assignment  from  a  pool  of  eligible 
officers  enables  conclusions  about  cause-and-effect  relationships. 

By  comparison,  for  our  larger  Army  FAO  program  we  propose  a 
quasi-experimental  design.  Quasi-experiments  require  sufficient  num- 
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bers  but  do  not  permit  random  assignment.  A  strong  benefit  of  this 
design  is  that  it  produces  generalizable  results,  although  it  is  difficult  to 
isolate  cause  and  effect.  For  instance,  if  officers  who  pursue  a  nonpro¬ 
motion  career  path  stay  in  service  longer,  it  may  be  hard  to  determine 
whether  the  cause  is  the  new  career  path  or  whether  those  who  are 
offered  the  new  path  have  different  external  job  opportunities  or  are 
more  prone  to  prefer  career  stability. 

Finally,  two  of  our  projects — the  Navy  SWO  and  the  Marine 
Corps  programs — are  designed  to  be  qualitative  case  studies.  While 
the  results  will  not  be  generalizable  due  to  the  small  numbers  of  partici¬ 
pants,  case  studies  generate  in-depth  qualitative  information. 

Demonstration  projects  with  experimental  or  quasi-experimental 
design  should  include  three  components:  (1)  a  comparison  group(s) 
that  is  similar  to  the  demonstration  group  but  does  not  experience 
main  project  interventions,  (2)  baseline  data  to  establish  the  conditions 
in  the  demonstration  group  and  the  comparison  groups  prior  to  the 
project’s  start,  and  (3)  a  longitudinal  design  involving  periodic  collec¬ 
tion  of  data  of  interest  and  that  can  be  used  for  any  necessary  midcourse 
correction.  Both  during  and  after  the  projects,  program  effects  can  be 
determined  through  a  series  of  comparisons  between  the  demonstra¬ 
tion  and  comparison  groups  in  order  to  evaluate  overall  effectiveness. 
Case  studies  may  also  require  baseline  and  longitudinal  data,  but  there 
is  little  value  in  collecting  the  same  data  for  a  comparison  group. 

Our  Four  Proposed  Demonstration  Projects 

The  four  policy  packages  we  propose  represent  specific  suggestions  for 
ways  to  implement  up-or-stay  demonstration  projects  and  address  a  host 
of  career  management  policies  related  to  promotions,  training,  assign¬ 
ments,  compensation,  and  retirement.  They  also  share  several  common 
themes.  First,  continuation  decisions  about  individual  officers  would 
be  primarily  based  on  employability  (performance  in  current  grades), 
not  promotability.  The  system  would  shift  to  “perform  or  out”  (either 
centralized  or  decentralized)  and  away  from  “promote  or  out.”  Second, 
these  programs  would  highlight  stability,  with  an  emphasis  on  longer 
careers,  longer  assignments,  and  less  geographical  change.  Finally,  these 
programs  would  minimize  required  changes  to  current  compensation 


xvi  New  Paths  to  Success 


policies,  using  instead  current  provisions  for  incentive  bonuses  and  TSP 
contributions  to  compensate  officers  for  longer  service. 

The  policy  packages  are  designed  as  follows: 

Policy  Package  1 :  Field  Experiment:  The  Air  Force  Effective  Man¬ 
ning  Fill  Program.  Several  Air  Force  occupations,  including  pilots, 
have  severe  “effective  manning”  shortages.  This  package  would  allow 
the  Air  Force  to  retain  a  small  number  of  0-4s  and  0-5s  in  occupa¬ 
tions  with  low  effective  manning.  Those  officers  in  undermanned  ca¬ 
reer  fields  who  do  not  attend  in-residence  intermediate  or  senior  ser¬ 
vice  school  would  be  randomly  selected  to  enter  the  program  around 
their  thirteenth  YOS  in  the  case  of  0-4s  and  seventeenth  YOS  for 
0-5s.  Participants  would  receive  a  four-year  employment  commit¬ 
ment  with  a  major  command.  Continuation  in  the  program  is  con¬ 
tingent  upon  continued  employability  tied  to  performance.  We  an¬ 
ticipate  a  program  size  of  roughly  25  0-4s  and  20  0-5s  added  per 
year,  eventually  reaching,  at  program  maturity,  about  450  0-4s  and 
280  0-5s,  if  all  continue  to  30  years. 

Policy  Package  2:  Quasi-Experiment:  The  FAO  Military  Profes¬ 
sional  Program.  Most  closely  in  keeping  with  OSD’s  original  idea 
for  a  demonstration  project,  this  program  would  eliminate  up-or- 
out  across  the  entire  Army  FAO  community.  Officers  would  be 
promoted  as  needed,  and  FAOs  beyond  20  YOS  would  require  an 
employment  commitment  from  a  user  agency  to  remain  on  active 
duty.  The  program  would  allow  FAOs  to  serve  up  to  statutory  re¬ 
tirement  age  regardless  of  grade.  The  FAO  community  is  an  ideal 
test  case  for  several  reasons.  First,  it  has  high  midcareer  training 
costs,  which  means  longer  careers  provide  greater  return  on  invest¬ 
ment.  Second,  FAO  expertise  is  hard  to  replace,  as  it  comes  from 
“soft  skills,”  tacit  knowledge,  and  personal  networks  developed 
over  a  long  career.  Finally,  extending  careers  for  FAOs  will  afford 
the  community  a  valuable  opportunity  to  explore  different  ways  of 
managing  officers’  careers.  Specifically,  FAOs  could  receive  train¬ 
ing  and  develop  expertise  in  two  complementary  Areas  of  Con¬ 
centration  (AOCs),  for  example,  the  Middle  East  and  South  Asia. 
The  program  would  apply  to  the  entire  FAO  community  of  about 
1,000  officers. 
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Policy  Package  3:  Case  Study:  The  SWO  Specialist  Program.  At 

present,  SWOs  who  do  not  screen  successfully  for  executive  officer  (XO) 
stand  little  chance  of  promotion  to  0-5  and  tend  to  leave  before  re¬ 
tirement  eligibility  at  20  YOS.  As  a  result,  the  Navy  is  short  hundreds 
of  SWOs  at  0-4.  These  shortages,  which  are  expected  to  continue  for 
several  years,  are  currently  dealt  with  through  bonuses.  The  suggested 
demonstration  project  recommends  additional  use  of  a  nonmonetary 
retention  incentive,  geographic  stability,  which  has  different  appeal.  In 
particular,  this  policy  package  will  enable  a  select  number  of  0-4s  per 
year  who  did  not  screen  successfully  for  XO  to  serve  in  shore-based  bil¬ 
lets  as  “SWO  Specialists,”  with  incentives  and  opportunities  to  serve  up 
to  their  twenty-fourth  year.  This  program  should  address  the  Navy’s  need 
to  retain  more  midgrade  officers  with  sea  duty  experience  while  making 
available  an  attractive  career  alternative  that  allows  for  both  greater  geo¬ 
graphic  stability  and  an  increased  recognition  of  expertise.  We  propose 
a  relatively  small  program  of  about  ten  0-4s  entering  annually  after  the 
XO  screening  point  and  five  more  annually  at  20  YOS,  with  about  120 
participating  officers  at  program  maturity.  This  number  of  officers  is  rea¬ 
sonable  for  a  demonstration  given  the  size  of  the  cohort,  the  available  job 
structures,  and  expectations  for  participation  rates. 

Policy  Package  4:  Case  Study:  Marine  Corps  Retention  of  Highly 
Valued  Officers.  While  both  the  SWO  and  Air  Force  programs  are 
driven  by  manning  shortages,  the  Marine  Corps  and  Army  FAO  pro¬ 
grams  explore  how  officer  careers  could  be  managed  differently.  Con¬ 
tinuation  in  this  program  will  be  based  on  an  officers  performance- 
based  employability  in  a  specific  assignment.  The  goal  is  to  give  the 
Marine  Corps  greater  flexibility  in  the  career  management  and  reten¬ 
tion  of  highly  valued  field-grade  officers.  At  present,  commanders  must 
go  through  a  cumbersome  continuation  process  to  retain  these  officers. 
Under  this  program,  a  small  number  of  valued  0-4s,  0-5s,  and  0-6s 
will  be  chosen  directly  by  a  command  or  agency  to  fill  headquarters 
staff  jobs  (e.g.,  in  HQ  USMC  or  at  Quantico)  where  their  tenure  and 
experience  could  improve  organizational  effectiveness.  Although  this 
package  is  the  only  one  designed  to  be  offered  servicewide,  it  will  also 
be  small  and  selective,  much  as  the  SWO  program,  accepting  approxi¬ 
mately  nine  officers  per  year,  which  is  a  reasonable  number  given  the 
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size  of  the  USMC  and  the  available  billets  each  year.  Marine  officers 
would  receive  monetary  incentives  commensurate  with  a  longevity  ba¬ 
sic  pay  increase.  They  would  also  enjoy  greater  geographical  stability 
with  longer  assignments  late  in  their  careers  and  would  continue  to  be 
eligible  for  promotion. 

These  different  policy  packages  are  tested  through  different  ex¬ 
perimental  methods  with  different  populations.  As  a  result  it  will  be 
difficult  to  compare  across  packages,  as  would  be  the  case  if  similar  ex¬ 
perimental  methods  with  similar  populations  were  used.  Such  a  design 
is  not  feasible  because  of  size  and  occupational  differences  among  the 
services. 


Next  Steps 

To  implement  these  policy  packages  as  demonstration  projects,  two 
steps  must  be  taken.  First,  the  services  must  formally  agree  with  OSD 
to  put  such  a  project  and  its  associated  policies  in  place.  Second,  be¬ 
cause  demonstration  projects  involve  changes  to  military  personnel 
management  practices,  Congress  must  grant  the  necessary  authority. 
OSD  bears  the  responsibility  for  seeing  that  both  of  these  steps  occur. 

We  recommend  that  OSD  seek  demonstration  project  authority 
for  military  personnel  similar  to  that  granted  to  the  Executive  Branch 
for  civilian  personnel  in  Title  5  of  the  United  States  Code.  This  process 
should  begin  immediately,  as  the  aim  of  the  project  is  to  begin  imple¬ 
mentation  of  the  policies  in  fiscal  year  (FY)  2005. 

Both  qualitative  and  quantitative  data  are  needed  for  evaluation 
of  the  programs  and  should  be  collected  before,  during,  and  after  the 
programs.  Interim  analysis  will  allow  for  program  refinement  along 
the  way.  Evaluation  should  include  analyzing  expected  resulting  grade 
structures,  career  tenure  profiles,  accession  requirements,  and  costs 
or  savings  generated.  Results  of  the  evaluation  will  provide  guidance 
to  OSD  regarding  program  design  features  that  would  likely  lead  to 
greater  cost  savings,  a  higher  officer  response  rate,  or  other  desirable 
outcomes.  More  importantly,  the  evaluations  will  address  the  advisabil¬ 
ity  of  administering  the  tested  policies  more  broadly  or  making  them 
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permanent.  Hie  implementation  and  evaluation  plans  will  be  specified 
in  more  detail  once  decisions  are  made  about  whether  and  how  to  pro¬ 
ceed  with  the  demonstration  projects. 

Ultimately  these  demonstration  projects  should  provide  a  wide 
range  of  results,  establishing  the  relative  value  of  specific  policy  alterna¬ 
tives  and  requirements,  such  as  incentives,  selection  criteria,  and  com¬ 
munity  impact.  In  addition,  these  projects  may  indicate  the  likelihood 
of  support  for  changes  to  the  existing  policy  and  the  level  of  satisfaction 
and  quality-of-life  improvement  experienced  by  those  participants. 
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CHAPTER  ONE 

Introduction 


The  Department  of  Defenses  (DoD  s)  Human  Resource  Strategy  is  de¬ 
signed  to  tie  military  human  resource  management  more  closely  to  mili¬ 
tary  missions  and  goals  and  the  internal  and  external  environment.  In 
developing  that  strategy,  the  Office  of  the  Secretary  of  Defense  (OSD) 
conducted  a  review  in  2000  of  the  officer  personnel  structures  that  result 
from  current  law  and  policy.  The  objectives  for  this  review  were 

•  to  increase  individual  choice  and  service  flexibility 

•  to  make  more  time  available  throughout  a  longer  career 

•  to  value  experience  and  maturity 

•  to  allow  seamless  career  flows 

•  to  improve  organizational  performance. 

The  Secretary  of  Defense  believes  that  one  way  to  achieve  these 
goals  is  to  extend  the  length  of  officer  assignments  and  the  length  of 
officer  careers.  In  his  view,  current  policies  drive  experienced  people 
to  leave  the  military  too  early.  The  head  of  the  secretary’s  Morale  and 
Quality  of  Life  Review  Panel  expressed  the  same  philosophy,  noting, 
“We  make  it  hard  for  people  to  stay.”1 

In  response  to  these  concerns,  the  Under  Secretary  of  Defense  for 
Personnel  and  Readiness  (USD[P&R])  chartered  research  and  studies 
to  support  transformational  change  of  the  officer  corps.  As  part  of  these 


1  ADM  David  Jeremiah,  “Special  DoD  News  Briefing  on  Morale  and  Quality  of  Life,”  United 
States  Department  of  Defense  News  Transcript,  June  13,  2001. 
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efforts,  the  National  Defense  Research  Institute  (NDRI),  a  division  of 
the  RAND  Corporation,  was  asked  to  design  and  determine  the  effec¬ 
tiveness  of  alternative  career  path  policies  that  could  result  in  longer  as¬ 
signments  or  longer  careers.  We  were  specifically  asked  to  design  alter¬ 
natives  to  the  up-or-out  promotion  policy  that  could  be  implemented 
as  demonstration  projects  in  selected  communities  within  one  or  more 
of  the  services.  However,  OSD  has  final  responsibility  for  the  design 
and  implementation  of  the  projects. 

The  project  complements  an  ongoing  NDRI  study  that  examines 
alternative  personnel  management  strategies  for  military  officers  and 
builds  upon  our  prior  experience  designing,  implementing,  and  evalu¬ 
ating  demonstration  and  pilot  projects. 


Up-or-Out  and  Up-or-Stay 

Almost  all  military  officers  are  subject  to  an  “up-or-out”  policy  that 
requires  separation  from  service  if  an  officer  is  not  promoted  within 
a  certain  period  of  time  and  is  not  selectively  continued  or  when  an 
officer  encounters  set  grade  tenure  limits.2  Such  a  policy  is  intended 
to  provide  a  strong  incentive  for  good  performance,  create  promotion 
opportunities  for  officers  in  lower  grades,  and  lower  the  average  age  of 
the  officer  corps.  Such  a  policy  also  contributes  to  a  culture  that  defines 
success  by  promotion. 

In  contrast,  many  private  and  public  sector  organizations,  as  well 
as  some  foreign  militaries,  have  “up-or-stay”  policies  that  allow  indi- 


2  For  example,  0-3s  and  0-4s  must  leave  within  six  months  of  a  second  promotion  nonselec¬ 
tion  unless  within  two  years  of  retirement,  at  which  point  they  must  leave.  0-5s  not  selected 
for  promotion  must  leave  at  28  years  of  service  (YOS)  and  0-6s  at  30  YOS.  In  general,  0-3s 
can  be  selectively  continued  by  a  board  to  20  YOS,  0-4$  to  24  years,  and  0-5s  and  0-6s  for  5 
additional  years.  Selective  continuation  (SELCON)  was  not  part  of  the  original  Defense  Offi¬ 
cer  Personal  Management  Act  (DOPMA)  legislative  proposal  from  DoD  and  was  incorporated 
during  congressional  consideration  of  the  proposal.  SELCON  deals  with  the  “back  end  of  the 
current  officer  management  system  by  offering  limited  continued  service  to  selected  individu¬ 
als  given  promotion  failure.  Up-or-stay  is  different  because  it  is  a  prospective  (“front  end”) 
alternative  career  path  that  is  success  oriented  by  other  measures  of  success  than  promotion. 
We  discuss  this  further  in  the  next  chapter. 
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viduals  to  enjoy  full  careers  even  if  they  do  not  advance  beyond  certain 
positions  or  levels.  Up-or-stay  does  not  entirely  preclude  separation  for 
unsatisfactory  performance,  separation  based  on  revised  tenure  rules, 
or  forced  separation  if  requirements  change.  An  up-or-stay  system  will 
generally  result  in  lower  turnover  (based  on  voluntary  attrition)  than 
would  an  up-or-out  policy  (based  on  forced  attrition).  Lower  turn¬ 
over  leads  to  greater  career  stability  and  a  more  experienced  workforce, 
which  could  reduce  the  number  of  accessions  and  training  costs.  In 
addition,  up-or-stay  is  more  consistent  with  career  practices  and  expec¬ 
tations  in  the  private  sector. 

Background 

The  military’s  up-or-out  policy  has  drawn  fire  from  critics  since  it  be¬ 
came  federal  law  in  1947.  While  the  legislation  was  before  Congress, 
Senator  Guy  Cordon  argued  that  the  policy  was  “wasteful  and  illogi¬ 
cal  for  the  technical  services.”3  In  1976  the  Defense  Manpower  Com¬ 
mission  concluded  that  the  policy  caused  morale  problems  and  per¬ 
sonnel  turbulence.4  More  recently  the  U.S.  Commission  on  National 
Security/2 1st  Century  argued  that  “the  triple  systems  of  up-or-out’ 
promotion,  retirement,  and  compensation  do  not  fit  contemporary 
realities.”5  Many  individual  officers  have  also  argued  against  the  up-or- 
out  system.6 

To  understand  why  up-or-out  is  still  policy  after  57  years  of  con¬ 
troversy,  one  must  understand  its  origins.  Prior  to  1947  the  policy  was 
neither  up-or-out  nor  up-or-stay;  it  was  a  strict  seniority  system  that  could 
be  characterized  as  “stay-then-up.”  The  system  had  a  pernicious  effect  on 
the  readiness  of  senior  military  leadership  at  the  outbreak  of  World  War  II. 


3  U.S.  Senate,  Committee  on  Armed  Services,  Officer  Personnel  Act  of  1947,  Hearings  80th 
Congress,  1st  Sess.,  July  16,  1947,  p.  5. 

4  Defense  Manpower  Commission,  Defense  Manpower:  The  Keystone  of  National  Security,  Re¬ 
port  to  the  President  and  the  Congress,  Washington,  D.C.,  March  1976,  p.  261. 

5  The  U.S.  Commission  on  National  Security /21st  Century,  Road  Map  for  National  Security: 
Imperative  for  Change,  February  2001,  p.  103. 

6  For  example,  Donald  VandergrifF,  The  Path  to  Victory:  America's  Army  and  the  Revolution 
in  Human  Affairs,  Novato,  Calif.:  Presidio  Press,  2002.  For  an  older  critique,  see  Nicholas  J. 
Schmitt,  “The  ‘Up-or-Out’  Policy,”  Navy  Proceedings,  December  1979,  pp.  35-40. 
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George  C.  Marshall  was  compelled  to  create  a  “plucking  board”  to  remove 
officers  deemed  unfit  for  command,7  and  Dwight  Eisenhower  later  testi¬ 
fied  to  Congress  that  “not  over  five”  of  the  Army  officers  available  to  com¬ 
mand  divisions  and  corps  at  the  start  of  the  war  served  in  World  War  II. 
“All  the  rest. . .  had  to  be  replaced  and  gotten  out  of  the  way,  and  younger 
men  had  to  come  along  and  take  over  the  job.”8  Thus,  up-or-out  became 
law  as  a  solution  to  a  specific  problem.9 

Up-or-out  has  been  a  career  management  policy  for  more  than 
half  a  century  now,  and  its  corollary  “youth  and  vigor”  ethos  is  in¬ 
grained  in  military  culture.  Conventional  wisdom  holds  that  without 
up-or-out,  the  military  will  once  again  be  burdened  with  antiquated  or 
substandard  officers.  Many  officers  therefore  see  a  very  clear  benefit  of 
keeping  the  up-or-out  policy.  When  presented  with  the  possibility  of 
changing  or  eliminating  it,  they  ask  a  fair  question:  “Why?” 

The  easiest  case  to  make  would  be  that  up-or-out  has  some  ob¬ 
vious,  first-order  effects  that  the  services  find  undesirable,  such  as  a 
large  number  of  0-3s  who  are  forced  to  separate  when  they  are  not 
promoted  to  0-4.  This  would  support  Senator  Cordons  argument  that 
the  practice  is  wasteful.  However,  the  members  of  the  line  communi¬ 
ties  we  met  with  do  not  believe  this  is  happening.  Some  communities 
are  paying  critical  skills  retention  bonuses  (CSRBs)  to  reduce  manning 
shortages;  some  fill  billets  by  having  very  high  promotion  rates;  all  have 
the  ability  to  selectively  continue  officers  who  are  not  promoted.10 


7  Forrest  C.  Pogue,  George  C.  Marshall:  Ordeal  and  Hope,  New  York:  Viking  Press,  1966. 

8  U.S.  Senate,  Committee  on  Armed  Services,  1947,  p.  1. 

9  Economic  and  social  conditions  of  the  day  exacerbated  problems  created  by  the  strict  senior¬ 
ity  system.  For  more  than  a  decade  leading  up  to  World  War  II,  the  economy  was  mired  in  the 
Great  Depression;  with  private  sector  jobs  scarce,  no  one  was  about  to  leave  a  secure  military 
job.  Even  with  a  stronger  job  market,  moving  to  a  civilian  job  would  have  been  difficult  be¬ 
cause  military  skills  were  less  technical  and  less  transferable  to  the  private  sector.  Older  officers 
also  were  not  as  healthy  as  their  counterparts  today.  When  the  mandatory  retirement  age  of 
62,  originally  set  in  1862,  was  reaffirmed  in  the  Officer  Personnel  Act  of  1947,  the  average  life 
expectancy  for  a  male  was  64.4  years.  While  nobody  is  suggesting  a  return  to  a  strict  seniority 
system,  it  is  important  to  keep  in  mind  the  conditions  that  made  up-or-out  necessary. 

10  We  discuss  SELCON  in  more  detail  later,  but  it  is  worth  noting  here  that  it  enables  officers 
who  otherwise  would  be  forced  to  separate  under  the  up-or-out  policy  to  stay  on  active  duty. 
In  other  words,  federal  law  already  acknowledges  that  the  services  want  to  retain  some  officers 
who  are  not  selected  for  promotion. 
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Other  contemporary  arguments  echo  the  conclusion  of  the  De¬ 
fense  Manpower  Commission  25  years  ago  that  up-or-out  causes  morale 
problems  and  personnel  turbulence.  The  2001  Army  Training  and  Leader 
Development  Panel  found  that  retirement-eligible  lieutenant  colonels 
and  colonels  do  not  feel  valued  for  their  experience  and  expertise.11  The 
Naval  Personnel  Task  Force  concluded  in  2000  that  “within  set  promo¬ 
tion  points,  officers  are  required  to  fulfill  more  requirements  than  can  be 
squeezed  into  the  time  available,”  resulting  in  shortened  command  tours 
and  ticket  punching  in  place  of  professional  development.12  Mr.  Rumsfeld 
has  said,  “the  Armed  Forces  make  a  terrible  mistake  by  having  so  many 
permanent  changes  in  station,  by  having  so  many  people  skip  along  the 
tops  of  waves . . .  serve  in  [a  job]  12,  15,  18,  24  months  and  be  gone.”13 

The  up-or-out  policy  and  resulting  promotion  pressure  is  a 
root  cause  of  these  problems,  but  the  U.S.  Commission  for  National 
Security/2 1st  Century  was  correct  in  identifying  up-or-out  as  part  of 
a  system  that  includes  compensation  policy  and  retirement  policy.  The 
findings  of  the  Army  and  Navy  panels  and  the  observations  of  Mr. 
Rumsfeld  suggest  that  it  is  reasonable  to  add  assignment  policy  to  the 
system.  If  up-or-out  is  part  of  a  system  that  has  some  undesirable  out¬ 
comes,  there  is  reason  to  believe  that  changing  up-or-out  in  concert 
with  changes  to  compensation,  retirement,  and  assignment  policies 
could  be  beneficial. 


This  Research  Project 

The  USD(P&R)  has  asked  RAND  to  recommend  alternatives  to  up-or- 
out  that  can  be  implemented  on  a  limited  basis  as  demonstration  proj- 


1 1  The  Army  Training  and  Leader  Development  Panel  Officer  Study  Report  to  the  Army,  Washing¬ 
ton,  D.C.,  May  2001,  p.  9. 

12  Naval  Personnel  Task  Force,  A  Strategic  Human  Resource  Management  System  for  the  2 1st 
Century :  Vol.  I,  September  2000. 

13  Remarks  before  the  Reserve  Officers  Associations  midwinter  conference,  January  20,  2003. 
Quoted  by  Rick  Maze,  “Rumsfeld  Broaches  Changes  in  Career  Structures,”  Army  Times,  Feb¬ 
ruary  3,  2003,  p.  12. 
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ects.  The  alternatives  entail  more  than  just  changes  to  the  law  requiring 
separation  or  retirement  for  officers  who  are  twice  failed  of  selection;  they 
can,  and  often  must,  address  a  host  of  career  management  policies  related 
to  promotions,  training,  assignments,  compensation,  retirement,  and 
more.  The  alternatives  are  therefore  packages  of  complementary  policies. 
We  were  also  asked  to  recommend  one  or  more  communities  in  one  or 
more  services  where  an  alternative  to  up-or-out  could  be  implemented. 
We  have  tailored  the  packages  to  particular  communities,  but  they  can 
be  adapted  to  other  communities  and  even  to  other  services. 

These  alternatives  will  be  implemented  as  demonstration  projects, 
which  enable  introducing  and  testing  new  policies  that  are  expected  to 
provide  beneficial  change  in  a  large  personnel  management  system.  The 
demonstration  or  test  might  require  changes  to  promotion,  compensa¬ 
tion,  assignment,  and  retirement  policies  in  statutes  and  directives  and 
could  therefore  require  some  combination  of  administrative  and  legal 
waivers.  In  addition,  if  the  projects  are  discontinued,  or  if  their  policies 
change  significantly,  the  original  program  participants  will  have  to  be 
accommodated  as  they  continue  their  careers. 


Organization  of  the  Report 

Chapter  Two  examines  options  for  designing  career  paths  that  were 
considered  in  this  study.  We  generated  some  options  ourselves,  but 
many  are  the  products  of  our  meetings  with  officers  ranging  in  grade 
from  captain  to  major  general  who  are  involved  in  personnel  policy 
and  management  in  each  of  the  services.  The  meetings  provided  critical 
guidance  for  the  shaping  of  alternatives  to  up-or-out  and  the  identifi¬ 
cation  of  appropriate  communities.  Our  discussions  with  the  services 
focused  on  how  officers  could  be  used  if  they  were  to  serve  longer,  who 
those  officers  should  be,  and  which  policies  could  be  changed  to  ac¬ 
commodate  longer  careers.  In  the  second  part  of  the  chapter,  we  offer 
OSD  two  options  for  obtaining  statutory  authority  for  implementing 
the  demonstration  policies. 

Chapter  Three  is  a  general  discussion  of  study  design  and  evalua¬ 
tion.  We  present  key  concepts  and  considerations  that  drive  decisions 
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about  the  implementation  approach  and  the  measurement  and  analysis 
of  outcomes.  The  real  conditions  under  which  this  study  will  be  imple¬ 
mented  affect  the  methods  for  analyzing  the  programs  as  true  field 
experiments,  quasi-experiments,  or  case  studies.  Adherence  to  well- 
established  principles  of  study  design  will  help  generate  the  strongest 
possible  conclusions  from  the  data  and  increase  the  potential  to  gener¬ 
alize  the  results  to  other  communities. 

An  activity  related  to  our  consideration  of  study  design  and  evalu¬ 
ation  methodology  was  a  review  of  federal  demonstration  projects  for 
civilian  personnel.  Federal  law  grants  the  Office  of  Personnel  Man¬ 
agement  (OPM)  the  ability  to  conduct  and  evaluate  demonstration 
projects  related  to  compensation,  qualification,  work  hours,  and  other 
management  practices  for  civilian  employees  of  the  federal  government. 
We  studied  the  design,  implementation,  and  evaluation  of  several  dem¬ 
onstration  projects  developed  under  this  authority.  Other  models  we 
considered  include  experiments  that  RAND  has  designed  previously 
for  the  military,  related  mostly  to  recruiting  incentives.  Summaries  of 
those  demonstration  projects  and  recruiting  experiments  are  provided 
in  Appendix  A  and  Appendix  B,  respectively. 

Chapter  Four  discusses  the  practical  aspects  of  selecting  communi¬ 
ties  where  a  demonstration  project  could  be  tested.  Although  OSD  could 
simply  ask  the  service  secretaries  to  craft  a  demonstration  project  for  one 
of  their  communities,  we  have  attempted  to  identify  certain  communi¬ 
ties  that  would  be  amenable  to  or  appropriate  for  participation. 

Chapter  Five  presents  specific  policy  packages  tailored  to  specific 
occupational  communities,  as  well  as  prescribed  evaluation  methods 
for  each.  These  recommendations  to  the  project  sponsors  are  not  in¬ 
tended  to  foreclose  the  opportunity  to  develop  additional  policy  pack¬ 
ages  for  other  communities  or  to  modify  the  existing  ones.  Indeed, 
some  negotiation  or  further  discussion  between  OSD  and  the  services 
is  expected  to  put  actual  programs  in  place.  These  next  steps  are  dis¬ 
cussed  in  Chapter  Six. 

The  appendices  contain  supplementary  information  on  previous 
OPM  demonstration  projects  and  DoD  experiments,  additional  ana¬ 
lytical  information,  and  suggestions  for  implementing  authority. 


CHAPTER  TWO 

Options  for  Designing  Career  Paths 


Up-or-out  is  part  of  a  complex  web  of  policies  that  shape  officer  ca¬ 
reers.  The  criticisms  of  up-or-out  presented  in  Chapter  One  are  part 
of  a  broader  argument  that  the  services  require  more  flexible  means  by 
which  to  shape  officer  career  paths  and  manage  personnel.  We  begin 
this  chapter  with  a  discussion  of  current  and  prospective  alternatives  to 
a  strict  up-or-out  policy.  Because  changing  a  single  policy  can  have  re¬ 
percussions  throughout  the  career  management  system,  we  also  exam¬ 
ine  related  policies  that  could,  or  should,  change  if  up-or-out  changes. 

Implementing  these  alternatives,  even  among  small  populations, 
requires  various  changes  in  law  or  directive.  Therefore,  we  close  this 
chapter  by  discussing  the  relevant  administrative  and  legal  consider¬ 
ations  induced  by  these  new  policies. 


Current  and  Prospective  Alternatives  to  Up-or-Out  Policy 

The  military  already  has  legislative  authority  to  selectively  continue  of¬ 
ficers  twice  passed  over  for  promotion.  These  officers  continue  at  their 
current  grade  and  even  remain  eligible  for  promotion  in  subsequent 
years.  0-3s  may  be  continued  to  20  YOS  and  0-4s  to  24  years.  In  our 
meetings  with  different  communities  and  services,  we  frequently  heard 
that  SELCON  effectively  means  up-or-stay  is  already  de  facto  policy, 
particularly  when  there  are  manning  shortages.  However,  the  officers 
we  met  with  also  acknowledge  that  SELCON  does  not  eliminate  the 
stigma  of  failure  for  those  who  are  not  promoted.  And  as  one  person 
told  us,  you  cannot  plan  a  career  around  SELCON.  In  fact,  the  argu- 
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ment  that  SELCON  makes  up-or-stay  unnecessary  can  be  turned  on 
its  ear:  The  fact  that  the  services  use  SELCON  indicates  that  up-or-out 
does  not  make  sense  in  many  situations. 

The  most  straightforward  alternative  to  up-or-out  is  to  simply  elimi¬ 
nate  the  requirement  in  federal  law  that  officers  who  are  twice  “failed  of 
selection  for  promotion”  within  a  single  grade  be  discharged,  retired,  or 
at  best  allowed  to  serve  up  to  two  more  years  in  order  to  qualify  for  retire¬ 
ment.1  As  an  alternative,  the  law  could  be  applied  only  to  junior-grade 
officers. 

If  eliminating  up-or-out  entirely  for  more  senior  officers  is  too  con¬ 
troversial,  there  are  closely  related  policies  that  could  increase  flexibility 
in  career  management  practices,  allow  some  officers  to  serve  in  grade 
longer,  and  reduce  or  delay  the  stigma  of  failure  and  the  uncertainty  of 
SELCON,  while  keeping  the  up-or-out  rule.  For  example,  officers  could 
be  considered  for  promotion  three,  four,  or  five  times  before  they  face 
mandatory  separation.  The  number  of  looks  an  officer  gets  could  even 
vary  by  grade — such  as  three  for  0-3s  and  four  for  0-4s  and  0-5s.  Or 
officers  could  be  allowed  to  choose  when  they  are  considered  for  promo¬ 
tion  within  time-in-grade  milestones  and  other  constraints  set  by  the  ser¬ 
vices.  A  third  alternative  is  to  move  promotion  points  further  out,  such 
as  14  YOS  for  promotion  to  0-4,  versus  the  current  goal  of  10  years. 

These  policies  would  not  abolish  the  principle  of  up-or-out  but 
would  still  achieve  some  of  the  same  goals  as  an  up-or-stay  policy.  They 
essentially  broaden  promotion  zones  and  lengthen  the  amount  of  time 
some  officers  serve  in  a  grade.  Lengthening  time  in  grade  will  pro¬ 
vide  officers  more  time  for  training,  additional  assignments,  and  lon¬ 
ger  assignments.  Broadening  promotion  zones  also  delays  the  need  for 
SELCON  until  later  in  an  officers  career. 


Related  Policies  for  Mandatory  Separation 

The  services  already  have  legislative  authority  to  hold  “show  cause” 
hearings  where  officers  must  make  a  formal  case  to  avoid  discharge, 


1  United  States  Code,  Title  10,  Section  632,  Effect  of  Failure  of  Selection  for  Promotion. 
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but  these  formal  inquiries  are  normally  reserved  for  the  most  egregious 
cases.  In  the  present  system,  the  services  tend  to  rely  on  the  promotion 
boards  to  weed  out  nonperforming  officers.  The  problem  is  that  up- 
or-out  also  applies  to  fully  qualified  officers  demonstrating  satisfactory 
performance  who  are  not  promoted;  the  services  use  SELCON  to  re¬ 
tain  such  officers  as  needed.2  If  up-or-out  were  modified  or  eliminated, 
the  services  would  need  some  means  of  pruning  nonperforming  offi¬ 
cers  short  of  resorting  to  formal  hearings  on  a  case-by-case  basis. 

Up-or-out  could  be  limited  to  company-grade  officers,  with  selec¬ 
tion  boards  making  more  permanent  retention  decisions  at  some  point 
between  an  officers  tenth  and  fifteenth  YOS,  which  is  when  officers 
are  usually  promoted  to  0-4.  By  that  time,  an  infantry  officer  will 
have  commanded  a  company,  a  surface  warfare  officer  will  have  been 
a  department  head,  and  a  pilot  will  have  been  a  flight  commander.3 
Officers  selected  for  continuation  could  be  automatically  promoted  to 
0-4,  or  they  could  be  promoted  on  an  as-needed  basis  but  without  the 
threat  of  mandatory  separation  if  they  are  not  subsequently  promoted. 
Nothing  would  necessarily  preclude  an  officer  from  becoming  a  major 
before  facing  the  selection  board.  Officers  not  selected  for  continua¬ 
tion  would  be  discharged.  This  is  similar  to  the  practice  of  the  British 
military,  which  has  two  key  continuation  decision  points  for  an  offi¬ 
cer — one  at  8  YOS  and  the  other  at  16  years. 

Another  variation  would  be  to  combine  the  functions  of  the  pro¬ 
motion  and  continuation  boards.  When  a  promotion  board  convenes,  it 
reviews  the  records  of  all  officers  within  and  above  the  promotion  zone, 
as  well  as  a  certain  number  below  the  zone.  Based  on  the  boards  deci¬ 
sions,  officers  fall  into  three  groups.  First,  some  officers  are  selected  for 
promotion.  Second,  some  are  not  promoted  but  are  implicitly  selected 
for  continuation  at  their  current  grade — that  is,  these  are  the  officers 


2  The  services  have  told  us  that  promotion  rates  in  some  competitive  categories  are  currently 
very  high,  and  separation  for  nonselection  is  consequently  rare.  Elimination  of  up-or-out  for 
those  categories  would  therefore  have  little  impact.  However,  if  conditions  change  and  promo¬ 
tion  rates  fall,  there  will  be  more  officers  who  are  fully  qualified  but  not  promoted. 

3  One  personnel  manager  told  us  that  by  the  time  a  cohort  reaches  the  promotion  zone  to 
major,  the  services  “know  who  the  good  ones  are.” 
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who  are  getting  their  first  look  but  are  not  selected.  Third,  still  other  of¬ 
ficers  are  being  reviewed  for  the  second  time  and,  when  not  selected,  face 
mandatory  separation.  In  practice,  then,  the  promotion  board  already 
looks  at  a  high  percentage  of  officers  and  makes  implicit  continuation 
and  separation  decisions.  Thus,  it  would  be  a  fairly  simple  change  to  the 
current  system  to  have  the  boards  designate  officers  as  promoted  or  con¬ 
tinued  based  on  performance,  with  all  others  separated. 

While  some  service  members  have  expressed  concern  that  elimi¬ 
nating  the  current  up-or-out  rules  would  allow  underperforming  of¬ 
ficers  to  remain  in  service  longer,  this  alternative  could  actually  remove 
them  earlier  in  their  career:  Instead  of  waiting  for  these  officers  to  be 
passed  over  for  promotion  twice,  the  boards  could  select  underperform¬ 
ers  for  separation  at  their  first  review,  shifting  the  emphasis  to  “perform 
or  out”  and  away  from  “promote  or  out.”  Moreover,  just  as  the  services 
already  have  requirements  for  promotion,  they  could  add  requirements 
for  continuation  based  on  performance  and  other  standards.  For  ex¬ 
ample,  officers  could  be  required  to  obtain  civilian  educational  degrees 
and  professional  certifications,  pass  fitness  tests,  and  meet  performance 
standards  to  be  continued  in  grade. 

A  different  approach  is  to  decentralize  the  process  by  taking 
continuation  decisions  out  of  the  hands  of  boards  altogether.  Beyond 
a  point  in  an  officer’s  career,  the  officer  could  be  required  to  obtain 
a  commitment  for  employment  from  a  command  or  agency  in  order 
to  remain  on  active  duty.  In  this  report,  we  refer  to  this  condition  as 
“employability”  and  suggest  it  as  a  decentralized  means  for  judging 
performance.  The  commitment  could  be  written  into  a  contract  or 
structured  less  formally.  The  community  or  assignment  manager  be¬ 
comes  a  facilitator  between  the  officer  and  the  command  or  agency, 
but  it  is  the  officer’s  responsibility  to  perform  and  to  stay  employable. 
The  community  manager  would  be  under  no  obligation  to  assign  an 
officer,  and  a  command  or  agency  would  be  under  no  obligation  to 
accept  an  officer  for  assignment.  Officers  must  separate  or  retire  when 
they  no  longer  have  a  commitment  for  employment.  With  such  a 
policy,  employability  rather  than  “promotability”  governs  continued 
service. 
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Related  Policies  for  Assignments  and 
Occupational  Specialties 

Assignments  both  lead  to,  and  result  from,  promotion.  In  the  Navy, 
for  example,  0-4s  stand  a  much  better  chance  of  promotion  to  0-5  if 
they  serve  as  executive  officers  of  a  ship.  Promotions  can  even  lead  to 
a  change  in  occupational  specialty.  If  a  service  overpromotes  officers 
in  one  career  field  and  underpromotes  officers  in  another,  some  in  the 
overpromoted  group  may  have  to  change  career  fields  to  meet  require¬ 
ments.  Clearly,  changes  to  up-or-out  or  closely  related  promotion  poli¬ 
cies  can  have  a  significant  effect  on  assignments. 

With  changes  to  up-or-out,  the  services  could  offer  career  alterna¬ 
tives  outside  of  the  command-and-promote  path  that  officers  follow 
today.  The  archetypal  example  is  the  “fly  only”  career  for  pilots.  In  one 
specific  program  we  propose  in  Chapter  Five,  a  small  number  of  Navy 
surface  warfare  officers  (SWOs)  could  be  chosen  as  SWO  specialists 
who  would  be  recognized  engineering  experts  who  train  ships’  engi¬ 
neering  departments  as  they  begin  workups  for  deployments.  Entry 
into  such  a  track  could  take  place  upon  failure  to  select  for  a  promotion 
or  command  assignment,  or  officers  could  self-select  prior  to  facing 
promotion  boards  or  command  screens. 

Rather  than  having  dual  paths  within  a  single  occupation,  the 
service  secretaries  could  create  more  competitive  categories  than  now 
exist  and  specify  which  competitive  categories  are  not  subject  to  up- 
or-out.  Appropriate  communities  for  exemption  would  be  those  with 
high  initial  training  costs  or  that  require  advanced  education  or  expe¬ 
rience.  Alternatives  in  this  area  might  be  officers  in  new  competitive 
categories  at  a  certain  year-of-service  point.  The  Army  has  adopted 
a  form  of  this.  Certain  restricted  line  communities  in  the  Navy  also 
access  a  large  percentage  of  their  officers  as  lateral  transfers  from  the 
unrestricted  line. 

Elimination  or  modification  of  up-or-out,  at  the  least,  would  en¬ 
able  officers  to  serve  in  assignments  longer,  pursue  additional  training 
and  education,  or  compete  longer  for  command  assignments.  Giving 
officers  more  time  in  assignments  and  time  in  grade  will  slow  down 
some  officers  who,  according  to  the  Secretary  of  Defense,  “skip  along 
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the  tops  of  waves,”  and  will  increase  geographical  stability,  which  can 
be  an  important  retention  incentive. 


Related  Policies  for  Compensation  and  Incentives 

Military  pay  tables  are  based  on  grade  and  cumulative  YOS.  For  each 
officer  grade  there  is  a  point  after  which  basic  pay  does  not  increase. 
For  example,  O- 3s  receive  their  last  pay  raise  after  their  fourteenth 
year  of  cumulative  service,  and  0-4s  after  their  eighteenth  year.  With 
replacement  of  up-or-out,  average  time  in  grade  is  likely  to  increase  at 
certain  grades,  as  are  cumulative  YOS.  Hence  more  officers  will  reach 
the  point  where  they  are  no  longer  eligible  for  structural  pay  increases 
based  on  the  present  pay  tables. 

If  up-or-stay  is  widely  implemented  and  the  compensation  and 
retirement  systems  are  not  radically  changed,  the  pay  tables  will  likely 
require  greater  longevity  increases  within  grades  for  longer  cumulative 
YOS  or  pay  banding  of  multiple  grades  so  that  officers  who  choose 
not  to  enter  the  command-and-promote  path  but  who  perform  well 
are  not  penalized  financially.  Any  changes  to  the  pay  table  will  have 
widespread  effects  across  all  services  and  communities.  For  the  pur¬ 
poses  of  the  demonstration  projects  we  propose,  we  explored  means 
of  increasing  officers’  pay  for  longer  tenure  without  changing  the  pay 
tables.  We  identified  existing  incentives,  such  as  CSRBs  and  the  Thrift 
Savings  Plan  (TSP)  contributions,  that  could  be  used  to  boost  officer 
remuneration. 

CSRB  packages  pay  bonuses  of  roughly  $10,000  to  $15,000  per 
year,  depending  on  the  length  of  the  contract  signed  by  the  officer. 
However,  a  CSRB  can  be  much  smaller  (only  about  $2,000  per  year, 
in  the  case  of  an  0-4  at  20  YOS)  to  be  commensurate  with  a  longevity 
increase.  The  services  also  have  the  authorization  to  make  contribu¬ 
tions  to  an  officer’s  TSP,  which  would  be  a  financial  incentive,  but  one 
deferred  to  retirement. 

Nonpecuniary  incentives  are  also  available.  As  noted  above,  geo¬ 
graphical  stability  is  important  to  some  officers,  particularly  those  with 
families.  All  officers  remain  eligible  for  promotion  while  on  active  duty, 
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which  is  itself  an  incentive  for  performance.  Although  it  is  unlikely  that 
officers  participating  in  the  demonstration  projects  will  be  promoted,  if 
up-or-stay  is  implemented  on  a  more  permanent  and  widespread  basis, 
there  may  be  a  number  of  officers  who  are  eventually  promoted  later 
than  they  otherwise  would  be.  While  the  demonstration  projects  are  in 
place,  OSD  officials  have  suggested  that  participating  officers  not  pro¬ 
moted  could  be  offered  “tombstone  promotions”4  upon  retirement. 


What  Legislative  Changes  Are  Needed  to  Test 
These  Policies? 

Although  we  aim  to  craft  policies  that  can  be  implemented  under  current 
law,  any  effective  modifications  to  up-or-out  will  likely  necessitate  new 
legislation.  On  the  civilian  side,  demonstration  projects  are  the  vehicle 
by  which  a  federal  agency  or  organization  obtains  the  authority  to  waive 
existing  code — Title  5  in  the  case  of  civilian  personnel — in  order  to  pro¬ 
pose  and  test  interventions  for  its  own  personnel  management  system. 
This  section  discusses  two  different  approaches  to  obtaining  authority  for 
demonstration  projects  involving  military  personnel. 

One  approach  is  to  request  specific  adjustments  to  various  sec¬ 
tions  of  Title  10  that  allow  targeted  changes  to  retirement,  promotion, 
mandatory  separation,  and  other  personnel  policies.  We  characterize 
this  as  “narrow  authority.”  A  second  approach  is  to  request  “broad  au¬ 
thority”  akin  to  Title  5  provisions  regarding  demonstration  projects 
carried  out  with  civilian  government  employees  as  participants.  Title  5 
permits  federal  agencies  to  conduct  and  evaluate  demonstration  proj¬ 
ects  relating  to  civilian  recruitment,  assignment,  promotion,  compen¬ 
sation,  and  incentive  bonuses.  The  law  states  that  the  demonstration 


4  Tombstone  promotions  historically  were  used  to  advance  officers  one  permanent  grade  upon 
retirement  if  they  had  been  specifically  commended  for  performance  in  combat.  Currently 
(e.g.,  United  States  Code,  Title  10,  Section  3962,  Higher  Grade  for  Service  in  Special  Posi¬ 
tions)  academy  permanent  professors  with  long  and  distinguished  service  can  be  retired  in  the 
grade  of  0-7.  The  concept  is  now  generally  used  to  reflect  promotions  that  might  be  made 
concurrently  with  retirement  from  the  military. 
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projects  “shall  not  be  limited  by  any  lack  of  specific  authority ...  to  take 
the  action  contemplated.”5  A  precedent  thus  exists  for  granting  broader 
authority  to  implement  such  programs.  The  law  for  civilian  personnel 
can  serve  as  a  model  for  securing  the  necessary  authority  to  implement 
policy  alternatives  to  up-or-out. 

Changes  sought  under  the  narrow  authority  approach  are  more 
likely  to  resemble  the  legislation  required  to  make  the  programs  perma¬ 
nent,  if  so  desired.  However,  such  changes  are  typically  implemented 
on  a  long  time  cycle  due  to  the  program  and  authorization  processes 
of  the  executive  and  legislative  branches.  Furthermore,  legislation  will 
have  to  wait  until  the  exact  policies  have  been  finalized  with  each  com¬ 
munity  and  service  and  may  not  provide  much  latitude  for  changing 
a  program  once  it  has  started.  On  the  other  hand,  broad  authority  can 
be  sought  in  parallel  with  discussions  with  the  services  to  work  out 
precise  policy  changes.  This  will  enable  faster  implementation  as  well  as 
subsequent  changes  to  programs  as  needed.  Appendix  C  contains  draft 
language  seeking  broad  authority,  which  should  be  refined  by  the  proj¬ 
ect  sponsor,  OSD  general  counsel,  and  the  services.  The  next  chapter 
discusses  evaluation  and  following  that  is  a  chapter  on  choosing  com¬ 
munities  for  demonstration  projects.  Chapter  Five  will  use  options  as 
discussed  in  this  chapter  to  design  specific  programs  to  test. 


5  Specifically,  Section  4703  of  Title  5  (United  States  Code,  Title  5,  Section  4703,  Demonstra¬ 
tion  Projects)  addresses  requirements  for  carrying  out  demonstration  projects.  Section  9507 
(United  States  Code,  Title  5,  Section  9507,  Streamlined  Demonstration  Project  Authority) 
greatly  diminishes  the  Section  4703  requirements  for  Internal  Revenue  Service  demonstration 
projects  conducted  by  the  Department  of  the  Treasury. 


CHAPTER  THREE 

Evaluation  of  Policy  Implementation 
and  Outcomes 


Within  the  federal  government,  agencies  have  carried  out  a  number 
of  demonstration  projects  to  test  prospective  changes  in  the  govern¬ 
mentwide  civilian  personnel  management  system.  A  variety  of  changes 
are  tested  through  the  demonstration  projects,  including  modifications 
to  job  classification,  hiring  processes,  compensation  policy,  employee 
development  opportunities,  and  reduction  in  force  (RIF)  procedures. 
Detailed  summaries  of  ongoing  and  completed  DoD  civilian  work¬ 
force  demonstration  projects  are  provided  in  Appendix  A. 

On  the  military  side  some  formal  experiments  have  been  con¬ 
ducted  to  test  new  recruiting  strategies.1  If  pursued  more  broadly  by 
the  military,  OPM-style  demonstration  projects  could  be  a  critical  tool 
for  military  personnel  planning  as  well.  Specifically,  as  these  projects 
are  designed  to  address  organizational  needs  and  problems  in  human 
resource  management,  they  could  be  a  valuable  means  by  which  to 
evaluate  alternatives  to  the  up-or-out  system.  As  discussed  in  Chapters 
One  and  Two,  demonstration  projects  involving  changes  to  military 
personnel  management  practices,  depending  on  their  characteristics, 
may  necessitate  congressional  action. 


Demonstration  Project  Design 

There  are  at  least  three  options  for  the  design  of  a  demonstration  proj¬ 
ect  in  the  current  context — a  field  experiment,  a  quasi-experiment,  or 


See  Appendix  B  for  summaries  of  recruiting  studies  in  which  RAND  participated. 
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a  qualitative  case  study.2  The  choice  of  a  design  depends  mainly  on  the 
method  of  participant  selection  and  the  number  of  participants,  and 
each  design  option  differs  from  the  others  in  the  types  of  conclusions 
it  permits.  Due  to  their  similarities  we  discuss  field  experiments  and 
quasi-experiments  together  first  and  then  discuss  situations  in  which  a 
qualitative  case  study  is  more  appropriate. 

Field  Experiments  and  Quasi-Experiments 

Ideally,  proposed  demonstration  projects  would  be  conducted  as  field 
experiments.  Two  main  features  of  field  experiments  make  them  the 
most  attractive  option  for  a  demonstration  project.  First,  like  laboratory 
experiments,  field  experiments  allow  for  the  manipulation  of  key  indepen¬ 
dent  variables.  That  is,  the  conditions  of  the  demonstration  project  are 
manipulated  by  the  designers  of  the  demonstration  and  are  not  simply 
preexisting  conditions  or  natural  characteristics.  In  our  case  we  would 
manipulate  the  career  paths  of  officers  in  one  or  more  demonstration 
groups  by  offering  them  one  or  more  alternatives  to  the  up-or-out  path. 
Second,  field  experiments  involve  random  assignment  of  subjects  to  condi¬ 
tions.  They  suit  situations  in  which  it  is  possible  to  assign  individuals  ran¬ 
domly  to  experimental  and  control  groups  within  a  defined  population. 

If  feasible,  field  experiments  are  the  design  of  choice  because  they 
are  characterized  by  a  reasonably  high  degree  of  control  over  confound¬ 
ing  variables — variables  that  can  cloud  results  and  limit  conclusions 
about  cause  and  effect  relationships.  In  other  words,  field  experiments 
exhibit  high  internal  validity.3  In  addition,  because  they  allow  an  in¬ 
tervention  to  be  tested  on  the  same  population  to  which  changes  will 
ultimately  be  applied,  they  tend  to  exhibit  high  external  validity  and 
are  thus  more  generalizable  than  laboratory  experiments. 


2  For  detailed  discussions  of  experimental  and  quasi-experimental  designs  in  field  settings,  see 
T.  D.  Cook,  D.  T.  Campbell,  and  L.  Peracchio,  “Quasi  Experimentation,”  in  M.  D.  Dunnette 
and  L.  M.  Hough,  eds.,  Handbook  of  Industrial  and  Organizational  Psychology :  Vol.  1,  Palo 
Alto,  Calif.:  Consulting  Psychologists  Press,  Inc.,  1990;  andT.  D.  Cook  and  D.  T.  Campbell, 
Quasi-experimentation:  Design  and  Analysis  for  Field  Settings,  Chicago:  Rand  McNally,  1979. 

3  The  ability  to  draw  conclusions  about  cause  is  the  essence  of  internal  validity.  External  valid¬ 
ity  is  the  ability  to  generalize  cause  and  effect  relationships  to  other  cases.  For  a  detailed  discus¬ 
sion  of  internal  and  external  validity,  see  Cook  and  Campbell  (1979). 
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A  more  common  design  in  demonstration  projects  is  the  quasi- 
experiment.  A  quasi-experimental  design  differs  from  a  traditional  field 
experiment  in  one  basic  way.  Quasi-experiments  do  not  involve  ran¬ 
dom  assignment  of  subjects  to  conditions.  Rather,  participants  (e.g., 
officers  in  a  selected  community)  may  be  separated  into  groups  based 
on  the  needs  of  the  management  system  or  based  on  their  own  personal 
and  career  choices,  just  as  they  would  if  the  policy  under  consideration 
were  to  be  formally  adopted. 

Quasi-experiments,  by  their  very  nature,  have  important  limita¬ 
tions.  They  cannot  definitively  establish  cause  and  effect  relationships 
due  to  limited  control  over  confounding  variables.  For  instance,  if  of¬ 
ficers  who  pursue  a  nonpromotion  career  path  stay  in  service  longer,  it 
may  be  hard  to  determine  if  they  do  so  because  of  the  changes  in  their 
career  paths  or  because  those  who  are  offered  the  alternative  career 
path  also  have  different  external  job  opportunities  or  are  more  prone 
to  prefer  career  stability.  As  a  result  of  this  limitation,  quasi-experi¬ 
ments  have  less  internal  validity  than  laboratory  or  field  experiments, 
which  are  characterized  by  a  high  degree  of  control  over  confounding 
variables.  Quasi-experiments  do,  however,  have  important  strengths. 
They  take  advantage  of  separations  into  groups  due  to  organizational 
or  individual  factors  and,  due  to  the  relatively  realistic  conditions  un¬ 
der  which  they  are  conducted,  they  are  usually  more  generalizable  than 
laboratory  experiments. 

Measurement  of  Dependent  Variables.  Both  field  experiments  and 
quasi-experiments  involve  the  measurement  of  dependent  variables, 
or  outcomes.  Selection  of  specific  outcome  measures  will  depend  on 
the  goals  and  implementation  details  of  the  demonstration.  In  general, 
data  of  the  following  sorts  should  be  collected  for  the  richest  results:4 

•  Quantitative  (i.e.,  countable  and  numeric)  data.  Examples  of  quan¬ 
titative  data  include  data  in  existing  service  databases,  such  as 


4  Guidelines  from  U.S.  Office  of  Personnel  Management  Demonstration  Projects  Evaluation 
Handbook,  www.opm.gov/demos/resources.asp  (April  1,  1999). 
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numbers  of  officers  in  a  given  pay  grade,  and  data  on  officer  sat¬ 
isfaction  with  the  newly  offered  alternative  career  paths  expressed 
in  numerical  ratings. 

•  Qualitative  data.  Qualitative  data  can  be  a  valuable  complement 
to  quantitative  data,  providing  important  information  that  is  not 
easily  expressed  with  numbers.  Information  on  policies  and  pro¬ 
cedures  as  well  as  officers’  reasons  for  electing  an  alternate  career 
path,  for  instance,  might  be  collected  as  qualitative  data. 

•  Objective  data.  Objective  data  are  factual  in  nature.  These  data 
may  be  either  quantitative  or  qualitative.  Examples  include  data 
on  accession  and  retention  rates  or  documents  describing  new 
criteria  for  separation. 

•  Attitudinal  data.  Attitudinal  data  are  based  on  individual  percep¬ 
tions.  Examples  include  attitudes  toward  policies  under  evalua¬ 
tion  (collected,  for  instance,  as  ratings  on  a  survey  or  verbal  com¬ 
ments  expressed  during  an  interview  or  focus  group).  They  may 
be  quantitative  or  qualitative. 

•  Data  on  the  accuracy  of  implementation.  We  will  advocate  gath¬ 
ering  data  as  part  of  a  process  evaluation5  to  confirm  that  the 
demonstration  is  being  conducted  consistently  according  to  the 
design  over  time.  If  the  conduct  of  the  demonstration  changes 
either  gradually  or  abruptly  during  the  course  of  the  project,  the 
outcome  measures  collected  at  different  points  in  time  will  not  be 
strictly  comparable  and  will  constrain  conclusions  about  the  ef¬ 
fects  of  the  demonstration.  These  data  may  also  be  quantitative  or 
qualitative  in  nature.  For  example,  they  may  result  from  numeri¬ 
cal  data  on  tenure  rates  or  interviews  with  key  staff 


Key  Elements  of  a  Demonstration  Project 

To  generate  the  strongest  possible  conclusions,  demonstrations  with  ex¬ 
perimental  or  quasi-experimental  designs  should  include  three  elements: 


5  For  more  discussion  of  process  evaluations,  see  Peter  H.  Rossi,  Howard  E.  Freeman,  and 
Mark  W.  Lipsey,  Evaluation:  A  Systematic  Approach,  Thousand  Oaks,  Calif.:  Sage  Publications, 
1999. 
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1.  Comparison  group(s).  This  group  does  not  experience  the  main 
project  interventions  but  should  otherwise  be  as  similar  as  pos¬ 
sible  to  the  demonstration  group.  For  instance,  we  might  com¬ 
pare  officers  who  participate  in  a  nonpromotion  career  path  to 
their  peers  within  the  same  cohort  who  remain  on  a  promotion 
path.  Other  possible  comparison  groups  are  a  previous  year’s  co¬ 
hort  within  the  same  occupational  group,  or  members  of  the  same 
occupation  in  a  different  service. 

It  is  important  to  note  that  the  choice  of  comparison  groups  is 
a  major  determinant  of  the  conclusions  that  can  be  drawn  from 
the  demonstration.  For  instance,  if  the  demonstration  group  differs 
from  the  comparison  group  both  in  terms  of  promotion  opportuni¬ 
ties  and  compensation  structure,  the  effects  of  changes  to  promotion 
and  compensation  policies  cannot  be  separately  determined.  Only 
their  combined  effects  can  be  examined.  Choosing  an  appropriate 
comparison  group  can  also  mitigate  some  of  the  potential  confounds 
that  might  threaten  the  validity  of  the  demonstrations  conclusions. 

2.  Baseline  data.  These  data  establish  the  conditions  in  the  demon¬ 
stration  group  and  the  comparison  groups  prior  to  the  projects 
start,  thus  serving  as  reference  points  that  can  be  used  to  account 
for  initial  differences  between  the  groups.  Baseline  data  are  also 
compared  with  longitudinal  data  (below)  to  assess  the  effects  of 
the  intervention. 

3.  Longitudinal  design.  Data  from  the  demonstration  and  compari¬ 
son  groups  should  be  collected  often  enough  to  detect  important 
changes  in  the  implementation  and  effects  of  the  demonstration 
project.  Such  data  can  be  used  to  make  midcourse  corrections  or 
other  decisions  about  the  conduct  of  the  demonstration.  It  may  be 
appropriate  to  measure  some  outcomes  more  frequently  than  others. 
To  avoid  time-related  confounds,  however,  comparable  data  should 
be  collected  from  all  groups  at  approximately  the  same  time. 


Qualitative  Case  Studies 

Sometimes  the  context  in  which  the  demonstration  will  be  conducted 
does  not  allow  for  either  a  field  experiment  or  a  quasi-experimental  de- 
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sign.  If  the  number  of  officers  expected  to  participate  in  an  alternative 
career  path  is  very  small,  a  qualitative  case  study  is  probably  warranted. 
Small  sample  sizes  are  likely  to  yield  insufficient  statistical  power  to  de¬ 
tect  effects  of  a  complex  intervention.  In  addition,  it  is  probably  not  wise 
to  assume  that  outcomes  observed  for  a  few  officers  in  a  single  occupa¬ 
tion  will  be  generalizable  to  their  entire  population,  much  less  to  other 
officer  populations.  An  advantage  of  case  studies,  however,  is  that  they 
can  allow  for  more  depth  in  the  examination  of  outcomes  for  the  popula¬ 
tion  in  question. 


Anticipating  and  Evaluating  the  Demonstration's  Effects 

Because  the  demonstration  projects  described  in  this  report  will  have 
real  effects  on  the  careers  of  military  personnel,  steps  should  be  taken 
to  anticipate  these  effects  in  advance.  As  described  later  in  this  report, 
we  have  begun  to  model  personnel  flows  associated  with  project  in¬ 
terventions  and  will  use  the  results  of  the  modeling  effort,  along  with 
input  from  community  managers,  to  refine  the  program  design.  As 
indicated  above,  periodic  data  collection  during  the  course  of  the  dem¬ 
onstration  will  also  allow  verification  that  programs  are  being  delivered 
as  intended  and  identification  and  remedy  of  any  program  features  that 
lead  to  undesirable  outcomes. 

For  case  studies,  data  will  be  collected  on  the  demonstration  group’s 
experiences  and  perceptions,  but  there  is  not  much  value  in  having  a 
comparison  group.  Even  with  a  comparison  group  it  will  be  difficult  to 
attribute  observed  or  reported  outcomes  to  the  demonstration  interven¬ 
tion  and  not  to  other  factors.  And  even  if  such  attribution  were  possible, 
it  would  be  unwise  to  assume  the  small  demonstration  group  would  be 
representative  of  larger  populations.  However,  for  demonstrations  with 
experimental  or  quasi-experimental  designs,  the  effects  of  the  demon¬ 
stration  will  be  determined  through  a  series  of  comparisons: 

•  We  will  compare  data  from  a  predemonstration  time  period  across 
the  demonstration  and  comparison  group  to  “net  out”  differences 
between  the  groups  at  the  start  of  the  project. 
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•  We  will  examine  trends  in  the  demonstration  and  comparison 
groups  over  time  so  that  we  can  identify  changes  in  the  environ¬ 
ment  during  the  course  of  the  demonstration.  An  example  of  such 
an  environmental  change  is  a  modification  to  personnel  policy 
that  is  initiated  outside  the  demonstration  but  that  potentially 
affects  participants  in  the  demonstration  and  comparison  groups 
differently.  Another  example  is  a  change  in  the  labor  market  that 
alters  retention  patterns  for  both  the  demonstration  and  compari¬ 
son  groups. 

•  Finally  we  will  “subtract”  trends  in  the  comparison  group(s)  from 
trends  in  the  demonstration  group  to  isolate  the  effects  of  the 
demonstration  intervention. 


CHAPTER  FOUR 


Choosing  Demonstration  Project  Communities 


In  addition  to  defining  policies  to  test  and  determining  necessary  legal 
waivers,  we  were  asked  to  identify  one  or  more  target  occupations  and 
services.  We  structured  our  assessment  around  policy  modifications 
that  could  be  applied  to  one  or  more  services  overall,  to  one  or  more 
different  communities,  or  to  individuals.  Each  project  was  designed  to 
be  different  in  terms  of  the  community  or  individual  to  whom  it  ap¬ 
plies,  and  the  projects  could  be  replicated  for  comparable  communities 
or  individuals  in  different  services.  All  projects  were  designed  to  be 
comparable  in  terms  of  meeting  the  desirable  outcomes  suggested  in 
Chapter  One  and  in  terms  of  being  measurable  against  criteria  such  as 
entry  into  the  program,  retention  (change  in  continuation),  career  ten¬ 
ures  (average  length  of  service),  experience  levels  (average  experience 
for  controlled-grade  officers),  assignment  tenures  (average  time  in  job), 
and  cost  (life-cycle  costs  including  accession,  training,  compensation, 
retirement).  Moreover,  all  projects  were  designed  to  have  a  discern¬ 
ible  front  end  and  specific  entry  means  and  to  not  just  be  a  change  to 
back  end  policies.  For  an  alternate  career  path  to  have  a  chance  of  suc¬ 
cess  depends  on  the  ability  of  the  officer  in  it  to  look  ahead  and  plan 
ahead.  The  front  end  (as  well  as  the  back  end)  has  to  change  for  a  career 
path  to  be  considered  planned.  Ultimately,  the  research  team  chose 
one  project  in  each  service  that  we  believed  fit  well  with  that  services 
or  community’s  needs  to  suggest  to  our  sponsor,  and  the  rationale  is 
discussed  in  this  chapter. 

Many  accept  the  logic  of  doing  away  with  up-or-out  for  mem¬ 
bers  of  certain  professions,  such  as  doctors  and  lawyers,  and  for  certain 
specialists,  such  as  those  in  the  acquisition  corps.  The  military  makes 
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large  investments  in  the  accession,  training,  or  education  of  such  of¬ 
ficers,  making  them  expensive  to  replace.  These  career  fields  are  also 
less  physically  demanding  and  are  similar  to  civilian  professions  where 
people  remain  capable  and  competent  long  into  their  careers.  Our  re¬ 
search  sponsor  was  less  concerned  with  these  professions. 

For  the  warfighting  communities,  however,  the  youth  and  vigor 
argument  holds  sway.  As  we  explained  in  Chapter  One,  up-or-out  was 
implemented  to  address  some  very  specific  problems  the  military  faced 
at  the  outset  of  World  War  II,  and  a  widespread  (but  not  unanimous) 
belief  is  that  without  up-or-out  those  problems  will  return.  Further¬ 
more,  people  in  conservative  organizations  such  as  the  armed  forces  are 
probably  more  inclined  to  observe  the  precept  that  one  should  not  fix 
what  is  not  broken.  So  lacking  prima  facie  evidence  that  up-or-out  is 
causing  many  officers  to  separate  sooner  than  either  they  or  the  services 
desire,  we  did  not  find  many  communities  willing  to  participate  in  a 
demonstration  project. 

Those  that  were  open  to  the  idea  of  an  alternative  to  up-or- 
out  or  at  least  were  willing  to  provide  some  guidance  as  we  shaped 
specific  policy  packages  typically  did  so  because  they  have  manning 
problems  they  wish  to  address.  Two  policy  packages  presented  in  the 
next  chapter — one  for  the  Navy’s  SWOs  and  one  for  Air  Force  line 
communities — attempt  to  address  manning  shortages.  Officers  from 
some  other  communities  believed  that  an  up-or-stay  demonstration 
program  would  have  no  effect  on  manning  shortages  because  of  the 
pull  of  high-paying  private  sector  jobs.  One  such  example  is  the  Army’s 
Special  Forces  warrant  officers. 

As  a  practical  matter  it  was  easier  to  get  cooperation  from  a  com¬ 
munity  if  it  had  a  manning  shortage.  The  risk  of  such  a  strategy  is  that 
an  up-or-stay  program  then  becomes  a  fix  to  a  temporary  problem 
and  the  benefits  of  implementing  it  as  a  more  permanent  policy  could 
be  ignored.  We  therefore  offer  two  other  policy  packages,  one  for  the 
Marines  and  one  for  Army  foreign  area  officers  (FAOs),  that  explore 
other  benefits  of  an  up-or-stay  system:  greater  flexibility  in  managing 
the  careers  of  highly  valued  officers  and  increased  return  on  investment 
in  training  and  education. 
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The  specific  policy  packages  for  Navy  SWOs,  Army  FAOs,  the 
Air  Force,  and  the  Marines  are  presented  in  the  next  chapter.  These 
are  simply  recommendations  that  OSD  may  choose  to  follow  or  to 
modify  as  deemed  fit.  The  policies  themselves  might  be  changed,  and 
we  have  already  discussed  alternative  ways  to  implement  an  up-or-stay 
demonstration  project.  The  communities  or  services  where  the  policies 
are  implemented  might  also  be  changed.  Accordingly,  we  now  provide 
some  general  thoughts  on  how  up-or-stay  policies  could  be  applied 
servicewide,  to  particular  communities,  and  to  individual  officers. 

Apply  servicewide.  Modifications  to  up-or-out  could  be  applied 
broadly  to  encompass  an  entire  service.  For  such  an  expansive  appli¬ 
cation,  a  demonstration  project  would  be  difficult  to  carry  out.  Such 
projects  usually  operate  within  a  specific  time  frame  and,  if  deemed 
unsuccessful,  they  can  be  ended.  To  undo  a  servicewide  policy  change, 
however,  would  be  unwieldy  at  best.  If  up-or-out  were  eliminated  ser¬ 
vicewide,  it  would  be  a  more  permanent  change  in  policy  to  be  evaluated 
rather  than  a  demonstration  project.  Program  evaluation  would  entail 
ongoing  monitoring  of  implementation  and  outcomes,  but  setting  up 
the  aspects  of  an  experiment  or  quasi-experiment,  such  as  comparison 
groups,  would  be  more  difficult.  Probably  the  only  comparison  groups 
with  some  validity  would  be  previous  cohorts  in  the  same  service. 

Apply  to  a  specific  community.  For  the  purposes  of  a  demonstra¬ 
tion  project,  a  participating  community  would  ideally  satisfy  several 
criteria: 

•  There  are  similar  communities  in  other  career  fields  or  another  ser¬ 
vice  that  can  be  used  as  comparison  groups,  or  there  is  a  sufficient 
number  of  officers  in  the  target  community  to  permit  random 
selection  of  one-half  to  two-thirds  of  them  for  the  demonstration 
group,  with  the  remainder  constituting  a  comparison  group  (i.e., 
according  to  the  current  up-or-out  system) . 

•  Officers  in  the  community  only  compete  amongst  themselves  for 
promotion. 

•  A  number  of  officers  each  year  are  not  promoted  and  must  either 
leave  or  be  selectively  continued. 
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•  Training  and  education  costs  are  large,  in  terms  of  money  spent  or 

years  invested  in  development. 

We  have  already  explained  that  for  practical  reasons  two  of  the 
policy  packages  we  present  in  Chapter  Five  are  for  communities  with 
manning  shortages.  However,  manning  shortages  generally  are  not  the 
hallmark  of  an  ideal  community  for  an  up-or-stay  demonstration  proj¬ 
ect.  This  is  not  to  suggest  that  up-or-stay  would  be  deleterious  in  those 
cases,  but  depending  on  the  reasons  for  the  gaps,  a  demonstration  proj¬ 
ect  might  not  yield  much  in  the  way  of  observable  results  because  the 
gap  might  be  structural. 

Apply  to  individuals .  If  an  up-or-stay  policy  is  implemented  ser¬ 
vicewide  or  for  an  entire  community,  the  default  assumption  is  that  it 
would  become  due  course:  Officers  not  promoted  would  stay  on  active 
duty  contingent  upon  satisfactory  job  performance.  A  different  way  to 
implement  up-or-stay  is  as  a  much  more  selective  program,  with  a  rela¬ 
tively  small  number  of  officers  exempt  from  the  up-or-out  rule.  A  pool 
of  eligible  officers  would  have  to  be  designated,  which  in  one  sense 
means  the  program  would  still  be  applied  servicewide  or  at  the  com¬ 
munity  level.  But  with  a  focus  on  individuals  the  up-or-stay  program 
has  a  different  look:  It  does  not  accept  everyone  who  misses  a  promo¬ 
tion;  instead,  it  takes  a  select  group  of  officers  who  compete  to  enter 
some  alternative  career  path  apart  from  command-and-promote.  A 
demonstration  conducted  at  the  level  of  a  few  select  individuals  would 
most  likely  be  designed  as  a  qualitative  case  study  and,  as  explained  in 
Chapter  Three,  would  therefore  probably  not  allow  attribution  of  ob¬ 
served  outcomes  to  changes  introduced  as  part  of  the  demonstration. 
Also  noted  in  Chapter  Three  is  that  the  outcomes  of  case  studies  may 
not  be  generalizable  to  larger  populations. 


CHAPTER  FIVE 

Demonstration  Project  Proposals 


In  this  chapter  we  present  four  demonstration  projects  customized  to 
particular  communities  or,  in  one  case,  to  an  entire  service.  The  four 
projects  directly  address  the  four  desired  outcomes  of  the  officer  struc¬ 
ture  review  discussed  in  Chapter  One.  Because  changing  the  up-or-out 
law  will  have  ramifications  for  other  aspects  of  officer  career  manage¬ 
ment,  these  projects,  including  those  discussed  in  Chapter  Two,  are 
really  packages  of  complementary  policies.  The  services  and  communi¬ 
ties  provided  significant  input  and  guidance,  although  none  offered 
an  endorsement  of  the  projects,  nor  did  we  ask  them  to.  These  policy 
packages  represent  specific  suggestions  from  RAND  to  OSD  of  ways 
to  implement  up-or-stay  demonstration  projects.  Table  5.1  on  page 
49  summarizes  and  compares  key  policies  from  each  demonstration 
project.  We  then  provide  a  detailed  discussion  of  the  policies  and  evalu¬ 
ation  plans  for  each  separate  demonstration  project.  We  list  the  dem¬ 
onstration  projects  in  order  of  scientific  rigor  (i.e.,  field  experiment 
described  first). 


Policy  Package  1:  Air  Force  Effective  Manning  Fill 

An  Air  Force  calculation  of  “effective  manning”  for  each  career  field  mea¬ 
sures  the  percentage  of  0-4  and  0-5  jobs  that  are  filled  by  officers  of 
the  respective  grade.1  Several  career  fields,  or  Air  Force  Specialty  Codes 


1  See  Appendix  D  for  detailed  calculations.  The  Air  Force  does  not  yet  have  a  definitive  ap¬ 
proach  to  calculate  effective  manning.  The  approach  we  outline  is  being  evaluated. 
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(AFSCs),  have  severe  effective  manning  shortages:  Pilots,  for  example, 
have  43  percent  effective  manning  at  0-4  and  35  percent  effective  man¬ 
ning  at  0-5.  Others  with  low  effective  manning  are  developmental  engi¬ 
neers,  scientists,  manpower,  and  public  affairs.  The  shortages  are  gener¬ 
ally  due  to  low  accessions  and  low  retention  in  recent  years. 

The  Air  Force  has  addressed  its  pilot  shortage  by  offering  Aviator 
Continuation  Pay  (ACP)  to  officers  who  have  completed  their  initial 
active  duty  service  commitment.  As  the  program  is  currently  structured, 
officers  through  the  grade  of  0-6  are  eligible  for  payments  of  $15,000  to 
$25,000  per  year  in  exchange  for  a  commitment  to  stay  for  three  years  or 
more.  Junior  pilots  are  much  more  likely  to  accept  an  ACP  agreement.2 
We  have  designed  a  program  that  targets  midgrade  pilots  as  well  as  of¬ 
ficers  in  other  career  fields  with  low  effective  manning. 

This  is  not  the  only  effort  under  way  to  explore  alternative  career 
paths  for  Air  Force  officers.  The  Air  Force  is  making  changes  to  profes¬ 
sional  military  education  and  assignment  policy  that  are  intended  to 
give  officers  more  control  over  their  careers  and  to  broaden  the  devel¬ 
opmental  experience  of  future  senior  leaders.  The  Effective  Manning 
Fill  program  complements  these  goals  by  slowing  the  rotation  of  of¬ 
ficers  through  some  billets  requiring  a  specific  AFSC,  thereby  enabling 
other  officers  to  serve  in  billets  outside  their  career  field.  While  those 
on  the  career  path  accumulate  broader  experience,  those  in  the  Effec¬ 
tive  Manning  Fill  program  develop  deep  functional  expertise.  In  the 
same  spirit,  Air  Force  Chief  of  Staff  General  John  Jumper  has  written 
that  the  Air  Force  “will  make  sure  that  qualified  people  who  do  not 
pursue  the  command  path  will  not  be  denied  advanced  professional 
development  and  a  rewarding  career  to  retirement.”3 

Program  Overview 

This  program  will  enable  the  Air  Force  to  continue  a  small  number  of 
0-4s  and  0-5s  in  AFSCs  with  low  effective  manning.  Continuation 
of  service  will  be  contingent  upon  having  an  employment  commit- 

2  Pilots  who  had  just  completed  their  active  duty  service  commitment  in  fiscal  year  (FY)  2001 
had  a  “take  rate”  of  58  percent  in  FY  2002.  Pilots  not  already  under  a  previous  agreement  or 
whose  agreement  expired  in  FY  2002  had  a  take  rate  of  27  percent. 

3  Gen  John  Jumper  (Air  Force  Chief  of  Staff),  “Chiefs  Sight  Picture”  November  6,  2002. 
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ment  from  a  major  command  (MAJCOM)  rather  than  approval  of  a 
SELCON  board,  which  is  the  current  procedure.  The  goals  are  to  address 
the  Air  Forces  need  to  retain  officers  in  occupations  with  shortages  and 
to  provide  a  clearer  path  to  longer  careers  for  high-performing  officers. 

Criteria  for  Participation.  Officers  in  undermanned  career  fields 
who  do  not  attend  in-residence  intermediate  or  senior  service  school 
will  be  eligible  to  participate.  These  officers  may  not  have  been  passed 
over  for  promotion  to  0-5  or  0-6,  but  they  are  not  on  the  command 
track  and  are  less  likely  than  their  peers  to  advance.  Out  of  this  group 
a  random  selection  of  officers  will  be  offered  the  opportunity  to 
participate  in  the  program. 

Participants  will  work  with  their  development  team  to  find  an 
assignment  with  a  MAJCOM  willing  to  offer  them  a  four-year  em¬ 
ployment  commitment.  Officers  newly  accessed  into  the  program  will 
be  assured  of  having  at  least  one  assignment.  Continuation  in  the  pro¬ 
gram  is  contingent  upon  continued  employability  tied  to  performance. 
At  the  end  of  a  four-year  commitment,  the  commitment  could  be  re¬ 
newed  by  mutual  consent  or  the  officer  could  obtain  a  commitment 
from  a  different  MAJCOM.4  If  no  MAJCOM  is  willing  to  offer  a  com¬ 
mitment  to  an  officer,  that  person  will  be  separated  or  retired. 

0-4s  will  serve  in  their  first  assignment  under  agreement  with  a 
MAJCOM  around  their  thirteenth  YOS,  and  0-5s  will  serve  in  theirs 
around  their  seventeenth  YOS.  Retirement  is  mandatory  at  30  YOS.5 

Program  Size.  Each  year  25  0-4s  not  selected  for  in-residence 
intermediate  service  school  and  20  0-5s  not  selected  for  senior  service 
school  will  be  randomly  selected  from  designated  AFSCs  with  low 
effective  manning  fill.  At  the  extreme,  if  all  officers  were  to  serve  to  the 
maximum  30  YOS,  there  would  450  0-4s  and  280  0-5s  participating 
once  the  program  were  fully  mature.  Currently,  the  AFSCs  identified 
as  having  particularly  low  effective  manning  fills  have  a  total  of  about 


4  As  discussed  earlier,  the  commitment  could  be  written  into  a  letter  contract  or  structured  less 
formally.  The  community  or  assignment  manager  serves  as  a  facilitator. 

5  Typical  commitments  would  last  four  years,  although  they  could  be  extended  to  round  out 
an  officer  s  career.  For  example,  a  commitment  could  be  lengthened  by  a  year  or  two  to  get  an 
officer  to  30  YOS. 
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4,000  0-4s  and  2,500  0-5s,  which  means  program  participants  would 
represent  about  1 1  percent  of  inventory  at  those  grades  and  about  4 
percent  of  all  officers  in  those  AFSCs. 

Assignments.  Officers  will  be  required  to  have  the  appropriate 
AFSC  and  grade  for  the  billet,  but  specific  assignments  will  be 
determined  by  the  agreements  with  the  MAJCOMs.  This  could  be  an 
opportunity  for  the  Air  Force  to  accommodate  The  Pilot  Who  Just 
Wants  To  Fly,  the  archetypal  officer  who  would  benefit  from  an  up- 
or-stay  program.  On  the  other  hand,  the  Air  Force  might  choose  to 
restrict  program  participants  to  assignments  in  nonflying  billets.  There 
are  about  240  operational  staff  billets  authorized  at  the  grades  of  0-4 
and  0-5  that  can  be  filled  by  any  rated  officer.  These  billets  are  primarily 
with  Air  Combat  Command,  Air  Education  and  Training  Command, 
and  HQ  USAF.  Likewise,  there  may  be  assignments  in  other  AFSCs 
that  the  Air  Force  wishes  to  either  place  program  participants  into  or 
keep  them  out  of. 

Incentives  and  Compensation.  Retention  bonuses  can  be  used  to 
provide  additional  compensation  to  long-serving  officers  who  stay  well 
past  their  last  longevity  basic  pay  increase,  which  occurs  after  18  YOS 
for  0-4s  and  22  YOS  for  0-5s.  The  bonuses  would  not  have  to  be  large 
to  be  commensurate  with  a  basic  pay  increase.6  DoD  contributions  to 
TSP  accounts  would  add  to  officers’  retirement  income.  By  law  every 
officer  is  considered  for  promotion  while  in  service,  so  there  would 
be  a  slight  possibility  that  participating  officers  could  be  promoted. 
Tombstone  promotions  (as  discussed  in  Chapter  Two)  are  also  possible. 
As  noted  above,  one  incentive  unique  to  this  program,  and  even  unique 
to  a  single  AFSC,  would  be  to  allow  some  pilots  to  remain  in  the 
cockpit.  That  alone  could  be  sufficient  incentive  for  some  officers. 

Training.  Participating  officers  may  require  periods  of  training  and 
education  to  remain  current  in  their  fields.  This  training  might  occur 
during  or  between  assignments.  Thus  despite  the  fact  that  officers  must 
continue  to  receive  employment  commitments  from  a  MAJCOM  in 


6  Using  the  January  2003  pay  tables,  a  3  percent  pay  raise  for  an  0-4  after  20  YOS  would 
equate  to  about  $2,000  per  year;  a  3  percent  pay  raise  for  an  0-5  after  24  YOS  would  equate 
to  about  $2,350  per  year. 
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order  to  remain  on  active  duty,  there  will  still  be  some  opportunity  for 
temporary  duty  training. 

Impact  on  Community.  There  are  several  communities  where  this 
program  might  be  implemented,  and  the  communities  may  have  some 
unique  aspects  in  terms  of  career  length,  promotion  opportunities,  and 
so  forth,  so  it  is  difficult  to  generalize  the  effects.  Instead,  we  focus  on 
possible  effects  on  the  pilot  community,  which  is  not  only  by  far  the 
largest  of  the  ones  where  this  program  would  be  implemented  but  also, 
for  obvious  reasons,  of  particular  interest  to  the  Air  Force. 

The  Air  Force  has  considered  making  a  fly  only  option  available 
to  pilots  but  has  never  done  so.  This  program  would  be  an  opportunity 
for  some  pilots  to  follow  such  a  path  without  the  Air  Force  ever  mak¬ 
ing  it  an  explicit  policy.  If  an  0-4  is  employable  as  a  pilot  and  there  is 
a  MAJCOM  willing  to  offer  an  employment  agreement,  that  officer 
could  enjoy  a  fly  only  career.  Because  of  the  requirement  that  the  officer 
have  an  employment  commitment  there  are  no  guarantees  of  a  fly  only 
career,  but  that  could  be  how  the  assignments  turn  out.  Alternatively, 
there  are  desk-job  assignments  that  require  rated  officers.  If  the  Air 
Force  could  lengthen  the  amount  of  time  a  rated  officer  cycled  through 
one  of  those  billets,  it  would  free  flying  time  for  other  officers. 

Using  the  methodology  outlined  in  Appendix  E,  we  calculate  low, 
middle,  and  high  estimates  of  increased  man-years  for  a  cohort  of  pi¬ 
lots.  This  range  of  estimates  is  necessary  because  we  do  not  know  what 
participants  would  otherwise  do  if  this  program  were  not  available.  If 
it  turns  out  that  the  officers  selected  to  participate  would  have  served 
long  careers  anyway,  the  program  will  have  a  small  effect  on  continua¬ 
tion  rates,  accessions,  and  man-years  served  by  a  typical  cohort.  If,  on 
the  other  hand,  the  officers  selected  to  participate  would  soon  leave 
active  duty,  the  program  effect  will  be  much  larger.  A  “middle-ground” 
estimate  assumes  that  the  participating  officers  would  be  similar  to  the 
rest  of  their  cohort  with  respect  to  continuation  rates — that  is,  some 
would  leave  soon  and  some  would  leave  in  a  few  more  years. 

The  impact  is  measured  in  additional  man-years  served  as  a  result 
of  the  program.7  Because  pilots  represent  the  largest  of  the  communi- 


7  See  Appendix  E  for  detailed  calculations. 
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ties  that  would  likely  participate  in  this  program,  we  assume  that  each 
year  20  of  the  25  new  0-4s  and  1 5  of  the  new  0-5s  in  the  program 
are  pilots.  Our  low  estimate  assumes  all  participating  0-4s  and  O- 
5s  would  have  served  to  24  YOS  and  28  YOS,  respectively,  without 
the  program.  With  all  now  serving  to  30  YOS,  the  low  estimate  is 
an  additional  150  man-years.  The  high  estimate  is  an  increase  of  570 
man-years,  assuming  all  0-4s  and  0-5s  would  have  otherwise  left  at 
13  YOS  and  17  YOS,  respectively.  For  the  middle-ground  estimate, 
we  assume  that  participating  0-4s  would  have  had  continuation  rates 
similar  to  their  peers  through  20  YOS,  when  all  remaining  would  have 
left,  and  likewise  for  0-5s  through  24  YOS.  Under  these  assumptions, 
man-years  would  increase  345  years.  Currently,  a  typical  cohort  of  pi¬ 
lots  serves  approximately  4,900  man-years  between  12  YOS  (about  the 
time  the  participating  0-4s  would  be  identified)  and  30  YOS.  This 
number  would  increase  by  3  percent  to  12  percent,  given  the  range  of 
man-year  effects  we  have  estimated.8 

One  positive  benefit  that  could  accrue  to  any  community  is  that 
as  some  officers  spend  more  time  in  certain  assignments,  it  frees  others 
to  serve  in  broadening  assignments  outside  of  their  career  field  as  they 
move  along  the  command  path.  Increasing  broadening  assignments  is 
one  of  the  goals  of  the  Air  Force  Senior  Leader  Management  Office  as 
it  changes  officer  development  policy. 

Demonstration  Design  and  Evaluation.  The  method  of  selecting 
Air  Force  officers  for  eligibility  to  participate  in  the  Effective  Manning 
Fill  program  allows  for  this  proposed  demonstration  to  be  conducted 
as  a  field  experiment.  Random  selection  of  officers  from  a  defined 
population  avoids  selection  effects  that  could  otherwise  make  the  results 
of  the  demonstration  significantly  more  difficult  to  interpret.  From  an 
experimental  design  standpoint,  first  categorizing  potential  participants 
according  to  a  few  relevant  demographic  characteristics  (such  as  years 


8  It  is  difficult  to  scale  these  impacts  to  the  total  man-years  served  by  an  entire  cohort  of  pilots 
beginning  with  the  first  year  of  service  because  large  numbers  of  officers  enter  the  community 
after  that  point.  Obviously,  though,  the  effect  of  the  program  would  be  much  smaller  than  a  3 
percent  to  12  percent  increase  in  man-years  if  the  baseline  includes  an  entire  cohort  of  pilots, 
rather  than  just  those  who  reach  12  YOS. 
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of  experience  or  educational  attainment)  and  then  randomly  assigning 
participants  from  each  category  to  the  demonstration  and  comparison 
groups  could  further  enhance  the  design.  Such  a  strategy  would  ensure 
that  the  starting  populations  in  the  demonstration  and  comparison 
groups  are  equivalent  in  a  few  key  respects. 

Officers  eligible  for  the  program  who  are  offered  participation 
(based  on  random  selection)  and  accept  the  offer  will  constitute  the 
demonstration  group.  The  comparison  group  would  consist  of  officers 
who  are  eligible  for  the  program  but  are  not  randomly  selected  to  par¬ 
ticipate.9  Additional  information  will  be  needed  from  the  participants 
in  the  demonstration  and  comparison  groups  so  that  adequate  meth¬ 
ods  to  control  for  baseline  differences  between  the  two  groups  can  be 
accounted  for  in  the  analyses. 

Several  types  of  data  should  be  collected  to  support  a  process  or 
implementation  evaluation  of  the  Air  Force  program.  Information  on 
the  backgrounds  of  the  officers  who  are  extended  an  offer  to  partici¬ 
pate  can  be  compared  to  the  stated  eligibility  criteria.  Officers  who  are 
accessed  into  the  program  should  be  interviewed  to  verify  that  their 
development  teams  helped  them  find  their  first  guaranteed  four-year 
assignment.  Finally,  to  ensure  that  effective  manning  shortages  are  in¬ 
deed  addressed,  data  should  be  collected  to  confirm  that  officers  have 
the  appropriate  AFSC  and  grade  for  the  billet  to  which  they  are  as¬ 
signed. 

A  main  outcome  of  interest  for  the  Air  Force  program  will  be  ef¬ 
fective  manning  at  0-4  and  0-5.  Effective  manning  can  be  calculated 
for  the  demonstration  and  comparison  groups  separately  and  then  com¬ 
pared.  Effective  manning  for  the  entire  demonstration  cohort  (compris¬ 
ing  the  demonstration  and  comparison  groups  from  the  same  cohort)  can 
also  be  compared  to  effective  manning  at  the  same  grades  for  previous 
years.  Other  variables  that  can  affect  effective  manning  at  0-4  and  0-5, 
including  accession  rates,  retention  rates,  and  changes  in  assignments  not 
related  to  the  demonstration,  must  be  tracked  and  controlled  for. 


9  Other  comparison  groups  could  be  used.  For  example,  one  could  comprise  officers  who  are 
eligible  and  offered  a  place  in  the  program  but  decline  to  participate,  depending  on  the  num¬ 
ber  of  such  officers.  Previous  cohorts  of  officers  can  also  be  used  as  comparison  groups. 
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Measures  aimed  at  gauging  officers’  interest  in  and  satisfaction  with 
the  program  should  also  be  collected.  A  simple  and  important  data  point 
will  be  the  number  of  officers  who  decline  an  offer  to  participate.  Those 
officers  should  be  interviewed  or  surveyed  regarding  the  reasons  for  their 
decision.  Likewise,  the  rationale  behind  accepting  an  offer  to  participate 
should  be  investigated  through  data  collection  focused  on  participants 
in  the  demonstration  group.  For  those  participants,  continuation  will 
be  contingent  on  employability.  In  addition  to  measures  collected  from 
program  participants,  a  key  measure  related  to  employability  might  be 
levels  of  awareness  of  the  program  among  MAJCOMs. 

The  exact  design  of  the  demonstration  project  for  the  Air  Force 
will  depend  on  a  number  of  factors,  including  the  specific  measures 
that  will  be  collected  and  the  expected  sizes  of  the  demonstrations  ef¬ 
fects  on  those  measures.  However,  one  important  feature  of  the  design 
can  be  anticipated  in  advance.  It  is  unlikely  that  comparison  groups 
will  be  constructed  that  allow  for  isolation  of  individual  aspects  of 
the  intervention  (e.g.,  changes  in  assignments,  compensation,  train¬ 
ing).  Rather,  the  demonstration  group  will  be  exposed  to  a  package 
of  changes,  and  the  comparison  group(s)  will  experience  none  of  the 
same  changes.  As  noted  earlier  in  this  report,  such  a  design  precludes 
separation  of  the  effects  of  different  aspects  of  the  intervention  on  the 
outcomes  of  the  demonstration.  It  will  therefore  not  be  possible,  for 
instance,  to  determine  the  extent  to  which  retention  effects  can  be  at¬ 
tributed  to  compensation  changes  as  opposed  to  the  dependence  of 
continuation  on  employability.10 


Policy  Package  2:  The  FAO  Military  Professional  Program 

Of  the  four  policy  packages  presented  in  this  report,  the  Army  FAO 
program  most  closely  resembles  what  OSD  originally  envisioned  when 
this  study  was  commissioned.  All  officers  within  the  community — not 
just  a  small,  select  group — will  be  managed  similarly  to  the  way  many 


10  Follow-up  demonstrations  that  isolate  the  impact  of  particular  aspects  of  the  intervention 
can  be  considered  if  an  effect  is  found. 
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private  sector  companies  manage  their  professionals.  The  program  will 
do  away  with  the  presumption  that  trained,  experienced,  fully  qualified 
officers  who  are  not  promoted  must  be  moved  out  of  the  way.  Invol¬ 
untary  separation  will  still  be  possible  for  unsatisfactory  officers,  but  it 
will  no  longer  be  treated  as  the  logical  alternative  to  promotion. 

For  a  number  of  reasons  it  makes  very  good  sense  to  test  a  pro¬ 
gram  such  as  this  for  Army  FAOs.  First,  officers  are  not  designated  as 
FAOs  until  they  are  at  least  0-4s,  so  the  offer  of  continued  employ¬ 
ment  for  satisfactory  performance  is  made  to  officers  with  approxi¬ 
mately  ten  YOS  or  more,  not  to  newly  accessed  lieutenants.  Second, 
this  is  a  community  with  high  midcareer  training  costs;  the  Army  in¬ 
vests  two  and  a  half  to  four  years  and  an  average  of  $50,000  in  training 
each  FAO-qualifled  officer.  Third,  FAO  expertise  is  based  on  much 
more  than  training  or  language  fluency.  Much  of  it  comes  from  “soft 
skills”  and  personal  networks  developed  during  in-country  training, 
when  an  officer  might  attend  a  school  overseas  with  foreign  military 
officers  and  others  native  to  the  area.  Friendships,  trust,  and  cultural 
understanding  nurtured  throughout  the  course  of  an  officer  s  career  are 
surely  more  difficult  to  replace  than  a  master’s  degree.  Additionally,  the 
foreign  military  officers  with  whom  the  FAOs  interact  often  have  lon¬ 
ger  service  in  their  parallel  role,  and  the  indigenous  peoples  with  whom 
FAOs  develop  relationships  often  have  tremendous  cultural  respect  for 
maturity.  These  factors  suggest  that  replacing  established  FAOs  with 
new,  younger  officers  undermines  the  strength  of  the  program.  Finally, 
extending  careers  for  FAOs  will  afford  the  community  an  opportunity 
to  truly  explore  different  ways  of  managing  officers’  careers  in  ways 
that  could  reap  significant  reward.  Specifically,  FAOs  could  receive 
training  and  develop  expertise  in  two  complementary  AOCs,  such  as 
Europe  and  Eurasia,  or  China  and  Southeast  Asia,  or  the  Middle  East 
and  South  Asia.  This  particularly  makes  sense  in  light  of  the  fact  that 
in  today’s  national  security  environment,  threats  to  the  United  States 
include  international  terrorist  networks  that  are  not  confined  to  par¬ 
ticular  countries  or  even  regions. 
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Program  Overview 

The  FAO  Military  Professional  Program  will  eliminate  the  up-or-out 
imperative  across  the  FAO  community.  Officers  will  be  promoted  as 
needed,  but  those  who  are  not  selected  for  promotion  twice  or  more 
within  a  single  grade  will  not  face  mandatory  separation  or  retirement. 
FAOs  will  be  able  to  serve  up  to  statutory  retirement  age  regardless  of 
grade,  provided  there  is  a  user  agency  willing  to  offer  a  commitment 
for  employment. 

Criteria  for  Participation.  This  policy  package  will  apply  to 
all  FAOs.  Army  officers  will  continue  to  be  accessed  into  the  FAO 
functional  area  and  begin  FAO  training  as  0-3s  and  will  receive  the 
FAO  career  field  designation  (CFD)  primarily  as  0-4s  (or  as  0-5s  and 
0-6s  in  some  cases),  subject  to  selection  by  a  CFD  selection  board.  All 
grade-based  service  tenures  will  be  removed  and  officers  will  be  allowed 
to  serve  until  the  statutory  retirement  age.  Currently  this  is  age  62, 
which  would  allow  officers  to  serve  up  to  approximately  40  years.  After 
initial  retirement  eligibility  at  20  Y OS,  the  conditions  for  continuation 
will  be  similar  to  those  of  the  Air  Force  and  Marine  programs:  Officers 
must  be  offered  a  commitment  for  employment  from  a  Major  Army 
Command,  Army  Headquarters,  or  DoD  for  a  period  of  three  to  five 
years.  Employability,  rather  than  promotability,  will  govern  continued 
service. 

Program  Size.  The  program  would  be  due  course  for  the  entire 
FAO  community,  which  currently  includes  about  1,000  officers  with 
the  FAO  career  field  designation.  About  200  more  officers  are  FAO 
qualified  but  remained  in  their  branch  in  the  Operations  career  field 
(these  are  officers  who  might  be  designated  as  FAOs  later  in  their 
careers). 

Assignments.  FAOs  are  currently  expected  to  serve  a  combination 
of  assignments  in-region,  within  the  continental  United  States,  and 
for  the  Combatant  Commands  with  geographic  responsibility  for  their 
AOCs.  This  policy  will  not  change.  Specific  assignments  beyond  20 
YOS  will  be  the  result  of  mutual  agreement  among  the  employing 
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command  or  agency,  the  individual  officer,  and  the  FAO  branch  chief 
or  appropriate  assignment  officer. 

Incentives  and  Compensation.  Again,  CSRBs  can  be  used  to 
compensate  officers  after  their  final  longevity  basic  pay  increase.  For 
officers  serving  beyond  30  YOS,  retirement  pay  could  continue  to 
increase  by  2.5  percent  of  basic  pay,  and  DoD  could  make  contributions 
to  officers’  TSPs  to  account  for  the  fact  that  pay  increases  will  take  the 
form  of  bonuses  later  in  an  officer’s  career. 

We  have  already  noted  that  officers  who  continue  on  active  duty 
are  already  considered  for  promotion  by  law,  and  the  FAOs  will  be  no 
different  in  that  respect.  What  sets  this  program  apart  from  the  others 
offered  in  this  document  is  that  it  will  be  applied  to  the  entire  commu¬ 
nity  and  will  therefore  include  officers  who  are  highly  competitive  for 
promotion.  To  ensure  that  lengthening  careers  does  not  significantly 
reduce  promotion  opportunity  for  highly  qualified  0-4s,  the  percent¬ 
age  distribution  of  0-4$  and  0-5s  could  “float”  while  the  combined 
number  of  officers  in  the  two  grades  remains  fixed.  (This  is  a  grade 
banding  concept  that  is  not  unlike  pay  banding.)  As  officer  careers  are 
extended,  we  would  expect  to  see  proportionately  more  officers  above 
zone  in  a  grade,  which  could  result  in  more  above-zone  promotions,  a 
higher  promotion  rate  for  officers  in  the  promotion  zone,  or  both.11 

Training.  This  program  will  enable  the  FAO  community  to 
explore  ways  to  support  Combatant  Commands  and  other  user 
agencies  more  effectively  by  managing  its  officers  differently.  With 
more  time  to  cross  train  officers  in  complementary  AOCs,  the  FAO 
community  can  more  easily  fill  requests  from  user  agencies,  which 
typically  come  with  very  short  notice.  FAOs  would  still  complete 
their  training  and  FAO  utilization  tour  to  become  functional  area 
qualified  for  one  AOC  as  0-4s.  They  could  then  be  given  incentives 
to  become  qualified  in  a  second  AOC,  perhaps  through  the  use  of 
responsibility  pay  or  critical  skills  bonuses  or  by  making  double 


11  For  example,  the  FY  2002  0-5  promotion  board  selected  seven  out  of  nine  (78  percent) 
Africa  FAOs  in-zone,  and  one  out  of  four  above-zone.  Supposing  that  this  program  resulted  in 
relatively  more  above-zone  officers,  selections  for  promotion  could  have  been  six  out  of  seven 
(86  percent)  for  in-zone  officers  and  two  out  of  six  for  those  above-zone.  These  numbers  are 
hypothetical  but  they  illustrate  the  point. 
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qualification  a  required  or  desirable  qualification  for  promotion  to 
0-6.  With  officers’  continuation  beyond  20  YOS  contingent  upon 
employability,  having  a  second  AOC  will  also  make  it  easier  for  them 
to  fill  a  billet  with  a  user  agency. 

In  addition  to  having  more  flexibility  to  meet  the  demands  for 
FAOs,  the  Army  will  enjoy  greater  certainty  in  reaping  return  on 
its  training  investment.  Currently  officers  are  accessed  into  the  FAO 
functional  area  between  their  fifth  and  sixth  YOS  and  subsequently 
begin  training.  Flowever,  not  all  officers  will  ultimately  be  designated 
into  the  career  field  as  0-4s,  either  by  choice  or  because  they  are  in 
basic  branches  with  shortages.  Sometimes  not  a  single  officer  from  a 
“shortage  branch”  will  receive  FAO  designation.  Conversely,  officers 
cross  trained  in  a  second  AOC  will  already  be  FAO  designated. 

Impact  on  Community.  Our  modeling  suggests  the  results  of 
these  management  changes.  The  fundamental  difference  in  the 
new  system  is  that  all  officers  are  permitted  to  stay  for  40  years  of 
commissioned  service.  This  longer  service  affects  both  the  number 
of  annual  FAO  designations  (and  thus  the  size  of  each  cohort)  and 
the  rate  and  timing  of  exits  from  the  community.  We  posit  that  the 
continuation  of  officers  will  vary  by  pay  grade  and  year  of  service,  as 
follows:  We  anticipate  that  few  0-4s  will  leave  the  service  prior  to 
20  YOS.  We  anticipate  approximately  48  FAO  designations  at  0-4 
annually.  Of  the  48  officers  in  a  cohort  group,  approximately  two- 
thirds  (32)  will  be  promoted  to  0-3  at  17  YOS.  Of  the  remaining  O- 
4s,  70  percent  of  them  will  retire  with  20  YOS.  The  remaining  small 
number  will  serve  until  30  YOS,  when  the  bulk  of  them  will  retire, 
but  a  very  small  number  (averaging  less  than  one  per  cohort  group) 
will  continue  to  40  YOS.  While  this  opportunity  will  be  available  to 
0-4s,  we  anticipate  that  few  0-4s  are  likely  to  remain  past  30  YOS. 

We  estimate  through  our  modeling  that  0-5s  are  more  likely 
to  stay  for  longer  service.  As  many  as  one-third  of  the  approximately 
32  officers  may  retire  at  20  YOS.  Of  the  approximately  20  officers 
remaining,  almost  two-thirds  (12)  of  them  will  be  promoted  to  0-6 
at  23  YOS.  We  anticipate  that  of  these  more  senior  officers,  approxi¬ 
mately  one-third  of  both  0-5s  and  0-6s  will  retire  with  30  YOS, 
and  that  about  1 5  percent  of  each  cohort  will  retire  each  year  after 
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31  YOS,  until  they  all  depart  at  40  YOS.12  The  result  of  this  will 
be  relatively  small  cohorts  at  each  year  of  service  between  30  and 
40  YOS.  For  example,  there  may  only  be  two  0-5s  with  33  YOS 
and  around  four  0-6s  with  35  YOS.  Should  this  attrition  rate  be 
somewhat  higher,  the  most  immediate  effect  would  be  a  change  in 
promotion  rates.  For  example,  should  0-6s  not  retain  to  40  YOS  at 
these  rates,  more  0-5s  would  be  promoted  to  0-6  and  more  0-4s  to 
0-5.  If  the  community  fails  to  retain  even  close  to  these  predictions, 
the  accessions  will  decrease  less  than  we  have  posited  and  promotion 
rates  will  increase.  Regardless,  average  experience  will  likely  increase 
and  accessions  will  decrease  if  behavior  moves  in  this  direction.  In 
fact,  as  posited  here,  the  average  experience  of  officers  would  be  16.5, 
23.5,  and  29.3  YOS  for  0-4s,  0-5s,  and  0-6s,  respectively. 

This  program  is  by  far  the  broadest  application  of  an  alternative  to 
up-or-out  for  any  of  the  communities  or  services  discussed  in  this  report. 
As  such,  it  could  have  a  greater  impact  on  accessions  and  promotions 
than  the  other  programs.  That  is  why  we  proposed  some  relief  from  the 
prescribed  grade  pyramid  for  0-4s  and  0-5s.  Another  consequence  is 
that  the  FAO  community  must  receive  100  percent  of  its  targeted  desig¬ 
nations.  Given  that  the  number  of  0-4s  entering  the  community  could 
decrease  to  less  than  50  officers  per  year,  any  missed  designations  could 
result  in  a  greater  proportion  of  total  designations.  Additionally,  with 
officers  serving  longer  as  FAOs,  each  unfilled  designation  requirement 
results  in  more  lost  man-years  over  the  course  of  a  career. 

One  of  the  disadvantages  of  such  a  revised  system  with  greater  ten¬ 
ure  and  experience  is  the  loss  of  some  flexibility.  For  example,  should 
there  be  a  dramatic  change  in  the  foreign  area  expertise  needed  by  the 
Army,  the  FAO  community  could  have  a  difficult  time  responding  be¬ 
cause  of  the  reduced  designations  and  longer  tenure  of  officers  with  the 
previously  prioritized  area  specialties.  One  solution  would  be  to  cross 
train  officers  in  different  world  areas  in  order  to  preserve  some  system 


12  Should  the  retirement  system  be  revised  so  that  field-grade  officers  continue  to  increase 
their  retirement  by  2.5  percent  each  year  past  30  YOS,  the  continuation  rate  at  30  YOS  might 
change  so  more  officers  continue  past  30  YOS.  Given  the  relatively  small  number  of  officers 
that  we  modeled  as  remaining  in  the  community  at  30  YOS,  this  would  have  only  an  incre¬ 
mental  effect  on  promotion  or  community  accessions. 
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flexibility.  This  would  avoid  the  predicament  of  having  a  dispropor¬ 
tionate  number  of  FAOs  trained  in  a  no-longer-hot  geographic  region. 
However,  an  officer  trained  in  Arabic  and  Portuguese  would  likely  not 
prove  as  mission  valuable  as  one  trained  in  geographically  similar  areas 
and  languages,  such  as  Arabic  and  Farsi. 

Reduced  designations  also  have  another  implication  for  the  train¬ 
ing  pipeline.  The  reduced  throughput  means  that  some  regional  and 
language  training  may  be  sporadic;  some  languages  and  regional  exper¬ 
tise  may  not  be  taught  with  every  cohort  group. 

Demonstration  Design  and  Evaluation.  The  demonstration  pro¬ 
posed  above  for  Army  FAOs  will  be  conducted  as  a  quasi-experiment. 
The  demonstration  group  will  consist  of  all  Army  FAOs,  and  likely 
comparison  groups  will  be  FAOs  in  other  services,  previous  cohorts  of 
Army  FAOs,  and  perhaps  members  of  the  Army  Acquisition  Corps — 
the  other  functional  area  in  the  Operational  Support  career  field.  The 
large  numbers  of  participants  make  detection  of  significant  effects 
much  more  likely  than  in  the  other  three  demonstrations  proposed  in 
this  report.  However,  the  lack  of  random  assignment  of  participants 
to  groups  will  make  ruling  out  alternative  explanations  of  the  results 
difficult  in  some  cases. 

The  program  for  FAOs  is  not  simply  aimed  at  addressing  man¬ 
ning  shortages  but  rather  fundamentally  changing  the  way  officer  ca¬ 
reers  are  managed,  and  the  evaluation  plan  should  reflect  that  purpose. 
Program  monitoring  in  this  case  will  be  relatively  straightforward.  The 
most  important  implementation  detail  to  monitor  will  be  the  reasons 
for  separation.  Interviews  and  document  review  can  be  used  to  verify 
that  officers  twice  failed  for  promotion  are  no  longer  automatically 
separated  and  that  employability  determines  continued  service  after 
20  YOS.  Any  planned  changes  to  training  incentives  or  requirements 
should  also  be  monitored. 

A  broad  set  of  measures  will  be  required  to  adequately  assess  all 
the  outcomes  of  interest.  Promotion  rates  (both  in-zone  and  above¬ 
zone),  retention  rates,  and  new  FAO  accessions  at  0-3  and  designa¬ 
tions  at  0-4  should  be  monitored  for  the  demonstration  and  compari¬ 
son  groups.  Data  on  numbers  and  proficiency  levels  of  FAOs  qualified 
in  two  AOCs  will  be  of  interest,  as  will  average  career  length.  Those 


Demonstration  Project  Proposals  41 


objective  data  can  be  complemented  by  information  on  the  percep¬ 
tions  and  satisfaction  not  only  of  officers  in  the  program  but  of  the 
agencies  or  commands  that  employ  them. 

For  a  program  of  the  size  proposed,  cost  becomes  an  important 
consideration.  Data  on  program  costs  should  be  considered  in  the 
context  of  changes  in  effectiveness.  In  this  case,  effectiveness  could  be 
measured  through  tests  of  proficiency  of  individual  officers  or  with  ap¬ 
propriate  measures  of  FAO  mission  fulfillment. 


Policy  Package  3:  The  SWO  Specialist  Program 

The  Navy  is  short  hundreds  of  SWOs  at  the  grades  of  0-4  and  0-5 
due  to  missed  accession  goals  and  historically  low  retention  rates  in 
the  1990s.  The  shortages  are  expected  to  continue  for  at  least  several 
years  to  come.  To  help  ameliorate  the  shortages,  the  Navy  pays  SWOs 
bonuses  totaling  $50,000  to  complete  their  department  head  tours 
and  up  to  $46,000  for  SWOs  who  elect  to  stay  to  three  years  beyond 
department  head  as  0-4s.  We  designed  a  policy  package  to  explore 
nonpecuniary  incentives  that  could  lead  to  greater  retention  and  fewer 
shortages  of  SWOs  at  the  grade  of  0-4. 

One  obstacle  to  retention  is  the  fact  that  0-4s  who  do  not  screen 
successfully  for  executive  officer  (XO)  stand  little  chance  for  promo¬ 
tion  to  0-5.  SWOs  get  up  to  three  “looks”  for  XO  after  promotion  to 
0-4,  typically  in  their  tenth,  eleventh,  and  twelfth  YOS.  At  about  their 
thirteenth  year  those  who  are  selected  begin  their  XO  tour,  which  is  a 
prerequisite  for  promotion  to  0-5.  With  the  up-or-out  law,  officers  not 
promoted  to  0-5  will  have  to  leave  active  duty  unless  they  are  within 
two  years  of  retirement  or  a  board  selects  them  for  continuation.  While 
SELCON  could  allow  them  to  serve  up  to  24  years  on  active  duty,  their 
last  pay  increase  as  an  0-4  would  come  at  the  eighteenth  year.  Further¬ 
more,  they  would  spend  much  of  their  remaining  time  labeled  as  failures 
of  selection  for  promotion,  and  they  and  their  families  might  continue 
to  be  moved  every  few  years  with  a  new  assignment.  Once  officers  do  not 
screen  for  XO  and  are  therefore  unlikely  to  be  promoted  to  0-5,  many 
transfer  to  another  community  or  leave  the  service  altogether. 
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One  could  argue  that  the  very  best  officers  are  selected  for  XO, 
but  it  is  widely  recognized  that  with  a  surface  warfare  community  of 
more  than  8,000  officers  and  only  240  surface  ships  to  serve  in  as  XO 
and  commanding  officer,  competition  is  fierce  and  many  capable  offi¬ 
cers  are  not  selected.  Many  junior  SWOs,  in  fact,  do  not  even  aspire  to 
command  at  sea,  according  to  junior  officer  surveys  sponsored  by  the 
SWO  community.13  Yet  they  must  serve  in  those  positions  if  they  wish 
to  remain  in  the  Navy,  thereby  filling  billets  that  might  have  gone  to 
other  officers  who  do  wish  to  command. 

Program  Overview 

We  have  designed  a  policy  package  that  will  enable  10  to  15  0-4s  per 
year  who  do  not  screen  for  XO  to  serve  in  certain  shore-based  billets 
as  “SWO  specialists”  (or  a  similar  job  title),  with  incentives  and  op¬ 
portunities  to  serve  up  to  24  YOS.  The  goals  of  this  SWO  Special¬ 
ist  Program  are  to  address  the  Navy’s  need  to  retain  more  midgrade 
officers  with  sea  duty  experience  and  to  provide  an  attractive  career 
alternative  for  SWOs  not  selected  for  XO  afloat  that  do  not  follow  the 
command-and-promote  path.  Once  in  these  alternative  paths,  officers 
who  are  not  selected  for  promotion  would  continue  without  requiring 
consideration  by  SELCON  boards. 

Criteria  for  Participation.  Selection  will  occur  at  one  of  two  points 
in  an  officers  career.  Most  officers  will  be  selected  after  their  cohorts 
third  screen  for  XO,  around  the  twelfth  YOS.  They  will  remain  in  the 
grade  of  0-4  and  will  serve  as  SWO  specialists  from  approximately 
the  fourteenth  YOS  through  the  twentieth.  At  that  point  they  will 
be  subject  to  a  formal  review  and  could  be  given  the  opportunity  to 
continue  to  24  years.  A  smaller  number  of  0-4s  will  be  selected  as 
new  participants  at  their  twentieth  YOS,  when  they  become  retirement 
eligible.  They,  too,  will  be  given  the  opportunity  to  continue  to  24 
YOS.  Once  the  program  is  mature,  a  single  SWO  specialist  board 
(with  membership  typical  for  such  boards)  can  handle  all  selection  and 
continuation  decisions.  It  will  select  officers  at  the  two  career  points 


13  Surface  Warfare  Officer  Junior  Officer  Survey,  1999  and  2001. 
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and  also  selectively  continue  officers  already  in  the  program  as  they 
reach  their  twentieth  YOS. 

Program  Size.  Although  we  do  not  prescribe  a  specific  number  of 
officers  to  be  selected  for  this  program,  we  envision  a  fairly  small  program: 
about  ten  selected  at  the  first  point  and  five  selected  at  the  second.  If  ten 
officers  were  chosen  every  year  after  their  third  XO  screen,  they  would  fill 
no  more  than  100  SWO  specialist  billets  at  any  given  time  (ten  officers 
in  each  of  ten  cohorts  up  through  24  YOS).  If  another  five  officers  were 
selected  as  they  approached  retirement  and  served  from  year  21  until 
year  24,  they  would  fill  an  additional  20  billets. 

Assignments.  The  officers  chosen  for  the  program  after  the  third 
XO  screen  will  complete  their  current  assignments  and  will  receive 
their  first  SWO  specialist  assignment  around  their  fourteenth  YOS. 
This  is  also  the  point  at  which  many  0-4s  today  leave.  The  officers 
will  be  given  a  six-year,  shore-based  assignment  (with  the  guarantee 
of  geographical  stability),  where  they  will  serve  as  recognized  experts 
in  their  fields.  Engineers,  for  example,  could  perform  their  duties  at 
Readiness  Support  or  Afloat  Training  Groups  at  Fleet  concentration 
areas  where  they  would  train  ships’  engineering  departments  as  they 
begin  workups  for  deployments. 

Incentives  and  Compensation.  One  of  the  key  incentives  in 
this  program  is  the  guarantee  of  geographical  stability  for  officers 
who  probably  will  not  be  promoted  beyond  0-4.  These  officers  will 
be  in  their  mid-  to  late-30s  and  many  will  have  families,  making 
permanent  changes  of  station  an  increasingly  negative  quality-of-life 
issue.  The  first  assignment  would  provide  at  least  six  years  for  a  shore 
assignment  (in  the  same  geographical  location).  An  officer’s  tenure 
could  be  extended  an  additional  four  years  (after  the  review  board) 
beyond  the  twentieth  YOS,  where  the  officer  could  be  given  a  new, 
four-year  assignment. 

An  incentive  may  be  necessary  to  entice  SWO  0-4s  beyond  their 
twentieth  YOS.  The  last  longevity  basic  pay  increase  for  an  0-4  occurs 
at  the  eighteenth  YOS,  after  which  basic  pay  rises  only  through  yearly 
cost-of-living  increases.  Retention  bonuses  can  be  used  to  compensate 
SWO  specialists  who  remain  beyond  their  twentieth  YOS.  The  bo- 
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nuses  would  not  have  to  be  large  to  be  on  par  with  basic  pay  raises  for 
0-5s  as  they  reach  22  and  24  YOS.14 

CSRB  authority  and  TSP  contributions  can  provide  additional 
compensation  to  participating  officers,  and,  as  noted  earlier,  the  SWO 
specialists  will  remain  eligible  for  promotion.  Those  who  are  promoted 
to  0-5  can  continue  to  28  YOS  and  can  even  be  considered  for  further 
promotion  and  longer  service.  Most  officers  in  this  program,  however, 
will  likely  retire  as  0-4s.  Those  that  do  could  receive  a  tombstone  pro¬ 
motion  to  0-5.  However,  those  that  make  0-5  while  on  active  duty 
will  not  receive  a  tombstone  promotion  to  0-6. 

Training.  Program  participants  typically  will  have  obtained  a 
master’s  degree  earlier  in  their  careers,  so  an  extended  period  for 
schooling  will  not  be  needed.  To  keep  current  in  their  fields,  officers 
will  have  shorter  periods  of  education  and  training,  perhaps  90  to  120 
days,  every  two  to  three  years. 

Impact  on  Community.  With  any  of  these  programs,  if  some 
officers  have  longer  careers  as  a  result  of  the  newpolicies,  the  community 
or  service  may  wish  to  lower  accessions  to  save  on  training  costs.  This 
will  not  happen  as  soon  as  the  policies  are  implemented  because  it  will 
be  too  early  to  tell  how  career  patterns  change.  Nevertheless,  we  can 
use  models  to  estimate  how  the  program  would  affect  end  strength  at 
maturity.  The  modeling  methodology  is  outlined  in  Appendix  E. 

The  program  impact  is  measured  in  terms  of  total  man-years 
served  by  a  cohort  through  the  course  of  a  30-year  career,  and  we 
translate  this  into  possible  accession  decreases.  Our  low  estimate  is 
a  negligible  change  in  man-years,  assuming  that  participants  would 
have  served  24-year  careers  anyway.  Our  high  estimate  is  an  increase 
of  120  man-years,  assuming  that  all  participants  would  have  left  the 
surface  warfare  community  immediately  upon  nonselection  for  XO 
or  upon  reaching  20  YOS  (depending  on  when  they  are  selected  to 
participate).  The  middle-ground  estimate  is  an  increase  of  74.8  man- 


14  Currently  0-5s  receive  a  2.7  percent  pay  raise  after  20  years  and  another  3.0  percent  raise 
after  22  years.  Using  the  January  2003  pay  tables,  those  equate  to  about  an  $1,800  increase  for 
0-4s  at  year  20  and  a  $2,000  increase  at  year  22. 
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years,  assuming  that  participants  would  have  continuation  patterns 
similar  to  the  entire  cohort.15 

The  middle  and  high  estimates  would  enable  accessions  to  decrease 
by  about  1  percent  to  2  percent,  which  is  basically  a  margin  of  error  for 
accession  goals.  This  leads  to  two  preliminary  observations:  First,  a  small 
program  such  as  this  in  a  community  as  large  as  surface  warfare  will  have 
very  small  systemic  effects.  Second,  to  the  extent  that  the  SWO  Specialist 
Program  is  intended  to  have  a  real  impact  on  the  inventory-authorization 
imbalance  (not  only  does  the  surface  warfare  community  have  a  shortage 
of  0-4s  and  0-5s  but  it  also  has  an  excess  of  0-1  s  and  0-2s),  it  will  have 
to  be  larger  than  we  have  proposed  as  a  demonstration  project. 

Demonstration  Design  and  Evaluation.  Due  to  the  small  numbers 
of  officers  expected  to  participate  in  the  proposed  program,  it  is  highly 
unlikely  that  an  experimental  or  quasi-experimental  design  could  yield 
statistically  detectable  effects.  This  program  should  thus  be  conducted 
as  a  qualitative  case  study,  and  interpreters  of  the  outcomes  should 
refrain  from  assuming  results  will  be  generalizable  either  to  other 
officers  in  the  SWO  community  or  to  other  officer  communities. 
Nevertheless,  a  number  of  outcomes  can  be  measured  with  respect  to 
the  SWO  specialists,  some  of  which  are  discussed  below. 

The  program  proposed  above  aims  to  satisfy  a  straightforward  goal, 
namely  to  address  current  shortages  of  0-4s  in  the  surface  warfare  com¬ 
munity  by  enhancing  retention  rather  than  increasing  accessions.  The 
most  basic  measure  of  the  programs  success  in  reaching  that  goal  is  the 
change  in  the  number  of  0-4s  as  a  result  of  the  demonstration.  Changes 
in  several  factors  other  than  the  proposed  intervention  can  affect  the 
number  of  0-4s  at  different  points  in  time,  including  the  following: 

•  promotion  rates,  most  immediately  from  0-3  to  0-4  and  from 
0-4  to  0-3 

•  accessions  (in  the  longer  term) 

•  number  of  0-4s  accepting  traditional  offers  for  SELCON 

•  number  of  0-4s  within  two  years  of  retirement 

•  lateral  entry  from  or  exit  to  other  communities  or  services. 


15  See  Appendix  E  for  detailed  calculations. 
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Efforts  should  therefore  be  made  to  determine  whether  any  of 
these  other  factors  might  be  causing  observed  changes  in  the  number 
of  0-4s. 

Another  outcome  of  interest  would  be  changes  in  the  number 
of  0-5s  as  a  result  of  the  introduction  of  the  SWO  specialist  track. 
As  indicated  above,  there  is  some  chance  that  0-4  specialists  would 
still  be  promoted  to  0-5.  It  is  also  conceivable  that  the  introduction 
of  the  demonstration  could  have  a  negative  effect  on  the  output  of 
the  regular  promotion  system.  For  instance,  if  significant  numbers  of 
SWOs  perceive  the  SWO  specialist  path  as  preferable  to  promotion  to 
0-5  (due  to  more  stable  assignments,  for  instance),  more  junior  SWOs 
or  identifiable  subsets  of  them  might  pursue  experiences  that  are  less 
likely  to  lead  them  to  promotion.  The  same  sorts  of  factors  that  must 
be  considered  in  interpreting  changes  in  the  numbers  of  0-4s  should 
be  considered  when  analyzing  any  changes  in  the  numbers  of  0-5s. 

A  group  of  measures  could  also  be  targeted  at  assessing  the  attrac¬ 
tiveness  of  the  SWO  specialist  option.  Information  on  the  number  of 
0-4s  who  are  offered  the  alternative  career  path  and  their  take  rate  can 
be  compared  with  data  on  the  career  paths  of  0-4s  in  previous  cohorts 
who  did  not  screen  for  XO.  How  many  left  active  duty?  How  many 
were  offered  SELCON?  How  many  accepted?  How  long  did  they  stay? 
Those  quantitative  measures  can  be  complemented  by  qualitative  mea¬ 
sures  aimed  at  discovering  officers’  reasons  for  accepting  or  rejecting 
offers  to  be  SWO  specialists  at  14  and  20  YOS,  as  well  as  data  on  the 
satisfaction  of  those  who  choose  the  SWO  specialist  option. 


Policy  Package  4:  Marine  Corps  Retention  of  Highly 
Valued  Officers 

Each  policy  package  presented  in  this  document  has  unique  aspects,  yet 
there  are  similarities  between  them  as  well.  The  Marine  policy  package 
is  unique  because  it  will  be  implemented  servicewide  but  will  be  simi¬ 
lar  in  size  and  selectivity  to  that  of  the  Navy.  It  will  make  continuation 
subject  to  decentralized  decisions  about  an  officers  performance-based 
employability  in  a  specific  assignment,  similar  to  the  Air  Force  and 
FAO  policy  packages.  The  Marine  policy  package  also  aims  to  explore 
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how  officer  careers  could  be  managed  differently,  rather  than  trying  to 
address  any  manning  shortages.  In  that  regard  it  is  more  like  the  Army 
FAO  policy  package. 

Program  Overview 

This  policy  package  will  allow  the  Marine  Corps  to  retain  a  small  num¬ 
ber  of  0-4s,  0-5s,  and  0-6s  to  fill  headquarters  staff  jobs  where  longer 
tenure  and  greater  experience  will  improve  organizational  effectiveness. 
Individual  officers  will  be  nominated  by  a  command  or  agency  to  fill 
a  specific  billet,  subject  to  approval  by  a  senior  officer.  The  goal  is  to 
give  the  Marine  Corps  greater  flexibility  in  the  career  management  and 
retention  of  highly  valued  field-grade  officers. 

Criteria  for  Participation.  Eligible  candidates  are  field-grade  officers 
who  would  otherwise  require  SELCON  to  remain  on  active  duty.  The 
pool  of  candidates  includes  0-4s  who  are  twice  failed  of  selection  for 
promotion  and  0-5s  and  0-6s  who  have  reached  28  and  30  years  of  active 
commissioned  service,  respectively.  An  officer  must  be  nominated  for  a 
specific  assignment  within  a  command  or  headquarters,  and  all  nominees 
will  be  subject  to  approval  by  a  senior  officer.  This  approval  could  be 
in  the  form  of  making  the  actual  selection  or  approving  the  results  of  a 
nonstatutory  selection  board.  (A  waiver  to  Title  10  to  allow  this  in  lieu  of 
the  normal  working  of  a  SELCON  board  would  be  needed.)  Approved 
officers  will  be  offered  a  contract  to  serve  within  the  position  for  a  period 
of  three  to  five  years.  Participating  0-4s  may  remain  on  active  duty  until 
24  YOS,  0-5s  may  remain  until  32  YOS,  and  0-6s  until  34  YOS. 

Program  Size.  The  program  could  be  designed  around  a  fixed 
number  of  assignments,  with  nominations  based  on  vacancies,  or  it 
could  be  designed  so  that  a  prescribed  number  of  officers  are  nominated 
each  year.  Either  way,  the  Marines  we  spoke  with  expressed  their  desire 
to  keep  the  program  small,  accepting  approximately  five  0-4s,  two 
0-5s,  and  two  0-6s  per  year.  If  the  average  assignment  length  is  four 
years  and  nine  officers  are  selected  to  participate  annually,  there  would 
be  about  36  billets  filled  once  the  program  is  mature. 

Assignments.  As  with  the  Air  Force  Effective  Manning  Fill, 
officers  will  be  required  to  have  the  appropriate  military  occupational 
specialty  (MOS)  and  grade  for  the  billet,  but  specific  assignments  will 
be  determined  by  the  contracts  with  the  command  or  headquarters. 
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Because  the  program  is  not  restricted  to  specific  occupations,  the  billets 
filled  and  officers  accepted  may  change  according  to  the  needs  of  the 
corps.  However,  there  will  be  significant  continuity  for  the  individual 
officers,  whose  assignments  will  last  from  three  to  five  years. 

Incentives  and  Compensation.  As  with  the  other  policy  packages 
Marines  will  receive  retention  bonuses  commensurate  with  a  longevity 
basic  pay  increase.  They  will  enjoy  greater  geographical  stability  with 
longer  assignments  late  in  their  careers  and  will  continue  to  be  eligible 
for  promotion  while  on  active  duty. 

Training.  One  key  benefit  for  both  the  officers  and  the  Marine 
Corps  is  greater  visibility  to  a  career  of  24  years  for  0-4s,  32  years  for 
0-5s,  and  34  years  for  0-6s.  Officers  may  be  identified  as  candidates 
before  they  actually  reach  the  point  where  they  are  nominated  for  the 
program  and  can  be  groomed  for  long-serving  jobs  at  the  end  of  their 
careers  by  means  of  training  or  an  earlier  assignment. 

At  the  time  of  nomination  officers  must  be  qualified  to  fill  the 
specific  billet  in  which  they  will  serve.  They  will  be  expected  to  keep 
current  on  skills  needed  for  their  assignments,  but  additional  training 
will  probably  not  be  necessary  once  an  officer  has  filled  a  billet. 

Impact  on  Community.  This  program  is  intended  not  to  address 
retention  or  accession  issues  but  to  change  the  way  officer  careers  are 
managed.  Therefore,  no  significant  effect  on  manpower  is  expected. 
The  program  will,  however,  streamline  the  process  of  retaining  specific 
individuals  and  will  remove  some  of  the  uncertainty  for  both  the 
officers  and  the  Marines. 

Demonstration  Design  and  Evaluation.  The  program  proposed 
here  for  the  Marine  Corps  clearly  lends  itself  best  to  a  qualitative  case 
study  design.  The  numbers  of  participants  will  be  purposely  kept 
small;  participants  will  be  handpicked,  not  selected  randomly;  and 
there  is  no  need  to  generalize  results  to  a  large  population.  In  this  case, 
qualitative  measures  targeted  at  the  outcomes  of  interest  will  be  of 
particular  importance.  Because  the  numbers  of  officers  in  the  program 
will  be  small,  in-depth  interviews  at  selected  times  and  using  a  formal 
interview  protocol  can  be  conducted  with  program  participants  and 
officers  up  the  chain  of  command.  Information  can  be  collected  about 
each  feature  of  the  program,  including  assignments,  training,  and 
compensation  to  make  local  adjustments  that  calibrate  the  program  to 
current  and  anticipated  Marine  Corps  needs. 
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Table  5.1 

Summary  of  Demonstration  Project  Proposals 


Air  Force 

Army  FAOs 

Navy  SWOs 

Marines 

Project  goal 

To  provide  high-performing  officers  with  a  clear  view  of  long  military 
careers  outside  of  the  command-and-promote  path.  Projects  will  test 
alternatives  to  current  policies,  identify  challenges  in  implementation, 
and  measure  individual  and  organizational  satisfaction  with  outcomes 

Eligible  officers 

04s,  05s  in 

Entire 

04s  not 

04s,  05s,  and  06s  in 

shortage  AFSC 

community 

screened 

any  occupation 

not  selected 

(04s  through 

for  XO  after 

for  in-residence 

06s) 

cohort's  third 

PME 

XO  screen 

Approximate 

25  04s,  20 

Current 

15  per  year; 

9  per  year;  36  total 

program  size 

05s  per  year; 

community 

120  total 

480  04s,  250 
05s  total 

size  is  1,000 

Criteria  to 

Random 

Field-area 

Board- 

Nomination  by 

participate 

selection  may 

designation 

screened  for 

command  or 

be  feasible 

asFAO 

initial  entry; 

agency;  approval  by 

review  at  20 

YOS 

Commandant 

Continuation  will  be  contingent  upon  having  a  renewable  employment 

commitment  from  an  agency  or  command 

Assignments 

Depend  on  needs  of  community/service  and  interest  of  officers  but  are 

expected  to  be  longer  than  typical  today 

Compensation 

Existing  statutes  allowing  for  incentive  bonuses,  Thrift  Savings  Plan 
contributions,  and  tombstone  promotions  to  compensate  officers 

serving  longer  careers 

Other 

Officers  continue  to  be  eligible  for  promotion  while  on  active 

incentives 

duty.  Longer  assignments  give  officers  and  their  families  increased 
geographical  stability.  Commands  and  agencies  have  incentive  to 
participate  due  to  increased  personnel  continuity,  organizational 

stability 

Maximum 

04s:  30  YOS 

04s:  40  YOS 

04s:  24  YOS 

04s:  24  YOS 

career  length 

05s:  30  YOS 

05s:  40  YOS 

05s:  32  YOS 

06s:  40  YOS 

06s:  34  YOS 

Type  of 

Experiment 

Quasi- 

Case  study 

Case  study 

demonstration 

experiment 

Comparison 

Eligible 

Other 

N/A 

N/A 

groups 

officers  not 

services' 

randomly 

FAOs;  prior 

selected 

FAO  cohorts; 
other  Army 
communities 

Applicability 

Individuals 

Community 

Individuals 

Individuals  within 

in  multiple 

within 

service 

communities 

community 
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If  alternatives  to  the  up-or-stay  system  are  to  be  implemented  as  dem¬ 
onstration  projects,  two  things  must  first  happen:  The  services  and 
OSD  must  formally  agree  to  put  such  a  project  and  its  constituent 
policies  in  place,  and  Congress  must  grant  the  authority  to  do  so.  OSD 
bears  the  responsibility  for  seeing  that  both  occur.  We  have  recom¬ 
mended  that  OSD  seek  demonstration  project  authority  for  military 
personnel  similar  to  that  granted  to  the  Executive  Branch  for  civilian 
personnel  in  Title  5  of  the  United  States  Code.  We  have  also  met  with 
representatives  of  each  of  the  services  several  times  and  have  designed 
four  specific  policy  packages  with  input  from  the  services  and  com¬ 
munities  affected.  These  recommendations  to  the  project  sponsors  are 
not  intended  to  foreclose  the  opportunity  to  develop  additional  policy 
packages  for  other  communities  or  to  modify  the  existing  packages.  In¬ 
deed,  some  negotiation  or  further  discussion  is  expected  between  OSD 
and  the  services  to  put  actual  programs  in  place.  The  aim  of  the  project 
is  to  begin  implementation  of  the  policies  in  FY  2005. 

The  other  set  of  recommendations  we  have  presented  here  relates 
to  evaluation  of  the  processes  by  which  the  policies  are  implemented 
and  of  their  outcomes  for  both  individuals  and  communities.  Evalu¬ 
ation  will  be  based  on  an  assortment  of  qualitative  and  quantitative 
data  and  will  be  conducted  as  the  demonstration  projects  are  ongoing. 
NDRI  will  continue  to  play  a  consultative  role  to  support  the  analysis 
and  refinement  of  the  projects  and  will  specify  implementation  and 
evaluation  plans  in  more  detail  as  decisions  are  made  about  whether 
and  how  these  specific  demonstration  projects  will  proceed. 
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The  length  of  the  implementation  phase  is  indeterminate.  As 
originally  envisioned  this  project  was  to  last  a  minimum  of  four  years, 
with  the  middle  two  years  allocated  to  conducting  the  demonstration 
projects  themselves.  However,  the  demonstration  projects  may  require 
more  than  two  years  to  generate  meaningful  results,  and  if  they  are 
implemented  broadly  for  a  large  number  of  officers,  the  demonstra¬ 
tion  projects  may  simply  become  de  facto  new  policy.  This  would  not 
be  unprecedented.  Demonstration  projects  implemented  for  civilian 
personnel  have,  in  some  cases,  continued  for  many  years. 

NDRI  will  analyze  the  progress  and  results  of  the  demonstration 
projects  and  will  develop  findings  and  recommendations  for  OSD. 
These  may  be  presented  while  the  demonstration  projects  are  still 
running.  Evaluation  will  include  analyzing  expected  resulting  grade 
structures,  career  tenure  profiles,  accession  requirements,  and  costs  or 
savings  generated.  We  will  offer,  where  applicable,  recommendations 
regarding  program  design  features,  such  as  structuring  of  incentives, 
the  officers  to  include  in  such  programs,  and  other  refinements  that 
would  likely  lead  to  greater  cost  savings,  a  higher  response  rate,  or  other 
desirable  outcomes.  NDRI  will  recommend  exit  strategies  as  neces¬ 
sary  when  OSD  wishes  to  terminate  a  demonstration  project.  Finally, 
the  evaluations  will  address  the  advisability  of  administering  the  tested 
policies  more  broadly  or  making  them  permanent. 
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Naval  Personnel  Demonstration  Project  ("China  Lake") 
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reduced  the  time  for  classification  actions  and  reduced  conflict  between  personnel  and  managers.  Average  salaries 
have  increased  two  to  three  percent  under  the  pay  banding.  Recruitment,  retention  and  reduced  turnover  of  high 
performers  and  increased  turnover  of  low  performers  have  all  improved.  Perceived  supervisory  authority  over 
classification,  pay  and  hiring  increased,  as  did  employee  satisfaction  with  pay  and  performance  management;  more 
than  70  percent  of  employees  are  supporting  the  demonstration  system."13  _ 
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Measurement  An  attitude  survey,  structured  interviews,  and  focus  groups  will  be  conducted  to  measure  perceived  organizational 
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Enlistment  Effects  of  the  2  +  2  +  4  Recruitment  Experiment 
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APPENDIX  C 


Legislation 


Section  4703  of  Title  3  (Government  Organization  and  Employees) 
of  United  States  Code  allows  the  Office  of  Personnel  Management 
(OPM)  to  conduct  and  evaluate  demonstration  projects  that  are  not 
limited  by  the  lack  of  specific  authority  under  Title  5.  Section  4703 
outlines  in  detail  what  actions  have  to  be  taken  in  order  to  conduct  a 
demonstration  project.  Section  9307  of  Title  5  contains  streamlined 
demonstration  project  authority  and  outlines  procedures  for  the  Sec¬ 
retary  of  the  Treasury  to  implement  demonstration  projects  for  the  In¬ 
ternal  Revenue  Service.  Title  10  (Armed  Forces)  of  United  States  Code 
provides  no  such  general  authority  to  conduct  demonstration  projects 
for  military  personnel. 

In  order  to  conduct  a  demonstration  project  of  alternative  career 
paths  for  military  personnel,  the  Department  of  Defense  (DoD)  could 
proceed  in  two  ways.  One  way  would  be  to  catalog  in  detail  all  of  the 
authorities  that  would  need  to  be  waived  in  order  to  conduct  the  dem¬ 
onstration  and  then  to  seek  the  specific  waivers  from  Congress.  Among 
the  difficulties  in  this  approach  is  that  DoD  might  not  foresee  a  waiver 
that  is  ultimately  needed,  and  assuming  that  the  Congress  would  grant 
it,  the  omission  could  delay  the  demonstration  project  by  up  to  a  year. 
The  second  approach  would  be  to  seek  broad  authority  for  the  Secre¬ 
tary  of  Defense  to  conduct  demonstration  projects  along  the  lines  of 
the  authority  granted  to  OPM  and  the  Secretary  of  the  Treasury  by 
Title  5.  This  latter  approach  is  the  one  we  recommend.  Language  simi¬ 
lar  to  that  immediately  below  (which  was  developed  in  conjunction 
with  the  project  sponsor)  would  allow  needed  authority. 


77 


78  New  Paths  to  Success 


Sec. _ .  Demonstration  Projects 

(a)  Hie  Secretary  of  Defense  may,  directly  or  through  agreement  or 
contract  with  one  or  more  agencies  and  other  public  and  private 
organizations,  conduct,  evaluate,  and  terminate  demonstration 
projects.  Subject  to  the  provisions  of  this  section,  the  conducting 
of  demonstration  projects  shall  not  be  limited  by  any  lack  of 
specific  authority  under  this  title  to  take  the  action  contemplated, 
or  by  any  provision  of  this  title  or  any  rule  or  regulation  prescribed 
under  this  title  which  is  inconsistent  with  the  action,  including 
any  law  or  regulation  relating  to 

(1)  the  methods  of  establishing  qualification  requirements  for, 
recruitment  for,  and  appointment  to  positions; 

(2)  the  methods  of  determining  requirements  and  compensating 
personnel; 

(3)  the  methods  of  assigning,  reassigning,  or  promoting  personnel; 

(4)  the  methods  of  providing  incentives  to  personnel,  including 
the  provision  of  group  or  individual  incentive  bonuses  or  pay; 

(5)  the  methods  of  involving  military  members  in  personnel 
decisions;  and 

(6)  the  methods  of  reducing  requirements. 

(b)  Before  conducting  or  entering  into  any  agreement  or  contract  to 
conduct  a  demonstration  project,  the  Office  shall 

(1)  develop  a  plan  for  such  project  that  describes  its  purpose, 
the  personnel  groups  to  be  covered,  the  project  itself,  its 
anticipated  outcomes,  and  the  method  of  evaluating  the 
project; 

(2)  provide  notification  of  the  proposed  project,  at  least  30  days  in 
advance  of  the  date  any  project  proposed  under  this  section  is 
to  take  effect 

(A)  to  personnel  who  are  likely  to  be  affected  by  the  project; 
and 

(B)  to  each  House  of  the  Congress; 

(3)  obtain  approval  from  each  Service  and  Defense  Agency 
involved  of  the  final  version  of  the  plan;  and 

(4)  provide  each  House  of  the  Congress  with  the  final  version  of 
the  plan. 
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(c)  No  demonstration  project  under  this  section  may  provide  for  a 
waiver  except  with  the  approval  of  the  Secretary  of  Defense. 

(d) 

(1)  Each  demonstration  project  shall 

(A)  involve  not  more  than  5,000  individuals  other  than 
individuals  in  any  control  groups  necessary  to  validate  the 
results  of  the  project;  and 

(B)  terminate  before  the  end  of  the  five-year  period  beginning 
on  the  date  on  which  the  project  takes  effect,  except  that 
the  project  may  continue  beyond  the  date  to  the  extent 
necessary  to  validate  the  results  of  the  project. 

(2)  Not  more  than  ten  active  demonstration  projects  may  be  in 
effect  at  any  time. 

While  we  believe  (subject  of  course  to  review  by  the  military 
services  and  Office  of  General  Counsel)  that  such  language  would 
be  sufficient  to  allow  for  waivers  of  existing  authority  in  order  to 
test  new  policies,  additional  authority  of  a  type  that  does  not  now 
exist  may  also  be  needed.  For  example,  the  concept  of  employability 
is  introduced  in  several  of  the  proposed  demonstration  projects  and 
it  will  be  necessary  to  determine  if  the  authority  to  separate  person¬ 
nel  on  such  a  basis  exists.  One  possible  method  for  implementing 
this  would  be  to  allow  involuntary,  but  not  mandatory,  separation  at 
existing  tenure  points  so  that  decisions  about  individual  officers  and 
not  groups  of  them  would  be  made.  Moreover,  if  and  when  a  dem¬ 
onstration  project  is  terminated  and  not  continued,  the  secretary  will 
need  authority  to  grandfather  or  otherwise  provide  relief,  if  needed, 
to  participants.  We  suggest  use  of  existing  compensation  authorities 
to  include  those  of  Title  37  as  “workarounds”  to  conduct  the  test. 
Waived  or  changed  Title  10  and  Title  37  authority  might  also  be 
needed  to  do  this. 

What  provisions  of  Title  10  might  in  fact  need  to  be  waived  in 
order  to  conduct  demonstration  projects  of  the  type  outlined  in  this 
report?  While  not  claiming  to  be  comprehensive,  we  believe  that  waiv¬ 
ers  of  at  least  the  following  might  be  needed: 
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•  Section  523:  Authorized  grade  strengths 

•  Section  611:  Convening  of  selection  boards 

•  Section  627:  Failure  of  selection  for  promotion 

•  Section  632:  Effect  of  failure  of  selection  for  promotion 

•  Section  633  and  634:  Retirement  for  years  of  service 

•  Section  1251:  Retirement  for  age 

•  Section  1370:  Retired  grade  commissioned  officers. 

Table  C.  1  aligns  such  waivers  with  each  proposed  demonstration. 
The  table  may  not  be  comprehensive. 


Table  C.1 

Suggested  Waivers  to  Title  10 


Proposed 

Demonstration 

Section 

Project 

Title  10 

Air  Force- 

632, 

designated 

633, 

communities 

634, 

611 

Army-FAO  627 


Reason  for  and  Effect  of  Waiver 
Section  632  mandates  discharge  or  retirement  if 
twice  failed  of  selection  to  the  next  higher  grade  for 
0-3  and  0-4.  (Policy  and/or  law  currently  allow  most 
to  reach  20  YOS.)  Section  633  mandates  retirement 
for  0-5  at  28  years  of  commissioned  service.  Waiver 
would  allow  certain  0-4s  and  0-5s  to  serve  for  up 
to  30  YOS  respectively  without  the  convening  of  a 
selection  board  under  Section  611(b).  Alternatively, 
waiver  of  the  procedures  for  statutory  selection 
boards  might  accomplish  the  same  purpose  or 
changing  the  authority  for  such  boards  from  Title  10 
to  regulations  prescribed  by  the  Secretary  of  Defense, 
which  presumably  would  provide  more  flexibility  in 
procedures. 

Section  627  designates  officers  below  0-6  not 
selected  for  promotion  as  failed  of  selection  for 
promotion.  Waiver  of  627  removes  the  failure  stigma. 
Officers  would  remain  continuously  competitive 
for  promotion.  (Additional  waiver  to  promotion 
procedures  may  be  needed.) 
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Proposed 

Demonstration 

Project 


Navy-SWO 


Table  C.1 — (continued) 


Section 
Title  10 

632, 

633, 
634 


523 


632 


523 


Multiple 
(or  new 
authority) 


Reason  for  and  Effect  of  Waiver 
Section  632  mandates  discharge  or  retirement  if  twice 
failed  of  selection  to  the  next  higher  grade  for  0-3 
and  0-4.  (Policy  and/or  law  currently  allow  most  to 
reach  20  YOS.)  Section  633  mandates  retirement  for 
0-5  at  28  years  of  commissioned  service  and  section 
634  mandates  retirement  of  0-6  at  30  YOS.  Waiver 
would  allow  0-4,  0-5,  and  0-6  to  serve  until  statutory 
retirement  age,  currently  62  or  approximately  40  YOS. 
Section  523  controls  the  distribution  of  officers  in  0-4, 

0-5,  and  0-6.  If  this  distribution  is  fixed,  promotion 
opportunity  and  flow  points  have  to  vary  if  officers 
serve  longer  in  grade.  Waiver  would  remove  0-4  and 
0-5  constraints  (would  leave  0-6)  that  would  allow  a 
greater  likelihood  of  achieving  policy  goals  for  promotion 
opportunity  and  timing  given  longer  careers. 

Section  632  mandates  discharge  or  retirement  if  twice 
failed  of  selection  to  the  next  higher  grade  for  0-3 
and  0-4.  (Policy  and/or  law  currently  allow  most  to 
reach  20  YOS.)  Waiver  would  allow  certain  0-4s,  to 
serve  to  24  YOS  without  the  convening  of  a  selection 
board  under  Section  61 1  (b). 

Section  523  controls  the  distribution  of  officers  in  0-4, 
0-5,  and  0-6.  If  this  distribution  is  fixed,  promotion 
opportunity  and  flow  points  have  to  vary  if  officers 
serve  longer  in  grade.  Waiver  would  remove  0-4  in 
the  program  from  the  calculation  and  would  allow 
a  greater  likelihood  of  achieving  policy  goals  for 
promotion  opportunity  and  timing  given  longer  service. 

Sections  3962  and  8962  allow  retirement  for  higher 
grade  for  service  in  special  positions  and  have  narrow 
applicability.  Waiver  (or  new  authority)  would  allow 
officers  in  this  program  to  be  retired  as  an  0-5  (if  not 
previously  promoted  to  0-5).  Retirement  pay  would 
not  be  affected. 
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Proposed 

Demonstration 

Project 

USMC- 

designated 

positions 


Table  C.1 — (continued) 


Section 

Title  10  Reason  for  and  Effect  of  Waiver 

632,  Section  632  mandates  discharge  or  retirement  if  twice 

633,  failed  of  selection  to  the  next  higher  grade  for  0-3 

634,  and  0-4.  (Policy  and/or  law  currently  allow  most  to 

61 1  reach  20  YOS.)  Section  633  mandates  retirement  for  O- 

5  at  28  years  of  commissioned  service  and  section  634 
mandates  retirement  of  0-6  at  30  YOS.  Waiver  would 
allow  certain  0-4s,  0-5s,  and  0-6s  to  serve  for  24,  32, 
and  34  YOS  respectively  without  the  convening  of  a 
selection  board  under  Section  611(b).  Alternatively, 
waiver  of  the  procedures  for  statutory  selection 
boards  might  accomplish  the  same  purpose  or 
changing  the  authority  for  such  boards  from  Title  10 
to  regulations  prescribed  by  the  Secretary  of  Defense, 
which  presumably  would  provide  more  flexibility  in 
procedures. 
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Air  Force  Effective  Manning 


The  Air  Force  effective  manning  can  be  calculated  as  the  percentage  of 
billets  being  filled  by  an  officer  with  the  appropriate  grade  and  AFSC. 
Officer  requirements  are  the  sum  of  the  number  of  officers  in  a  single 
grade  with  a  particular  AFSC,  plus  the  number  of  vacant  billets  in  that 
grade  for  that  AFSC.  Filled  billets  are  calculated  as  the  number  of  of¬ 
ficers  in  a  single  grade  with  a  particular  AFSC  minus  the  number  of 
vacant  billets  at  the  next  lower  grade. 

These  calculations  make  two  assumptions.  First,  they  assume  all 
officers  who  are  assigned  in  “non-core”  duty  AFSCs  are  appropriately 
assigned  to  meet  needs  of  the  Air  Force.  Therefore,  a  pilot  with  an  engi¬ 
neering  duty  AFSC,  for  example,  is  assumed  to  be  a  pilot  requirement. 
The  calculations  also  assume  that  0-4s  can  fill  company  grade  vacan¬ 
cies,  0-5s  can  fill  0-4  vacancies,  and  0-6s  can  fill  0-5  vacancies. 

Table  D.l  is  an  example  of  effective  manning  calculation  for  pi¬ 
lots. 
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Table  D.1 

Air  Force  Calculation  of  Effective  Manning 


Grade 

Requirements 

Inventory 

Filled 

Billets 

Vacant 

Billets 

Effective 

Manning 

0-1 -0-3  7,479 

5,557 

5,557 

1,922 

0-4 

2,480 

2,987 

2,987-  1,922 
=  1,065 

2,480-1,065 
=  1,415 

1,065/2,480 
=  43% 

0-5 

1,722 

2,023 

2,023-1,415 
=  608 

1,722-608 
=  1,114 

608/1,722 
=  35% 

SOURCE:  Air  Force  Senior  Leader  Management  Office. 
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Navy  and  Air  Force  Program  Modeling 


To  calculate  the  impact  of  the  policy  packages  in  the  affected  Navy  and 
Air  Force  communities,  we  calculated  the  expected  man-years  served 
by  an  entire  cohort  with  and  without  the  new  policies.  The  calculations 
were  generated  using  historical  data  to  predict  cohort  size  and  continu¬ 
ation  rates.  The  Navy  data  were  provided  by  DMDC  and  covered  the 
period  1987  to  2002;  the  Air  Force  data  were  provided  by  the  Air  Force 
Personnel  Center  and  covered  the  period  1994  to  2002. 

The  calculations  required  several  steps.  We  began  by  finding  year- 
to-year  continuation  rates  and  average  cohort  sizes  in  each  community. 
Using  these  parameters,  we  generated  a  cohort  profile  through  30  YOS, 
so  that  a  cohort  gradually  diminishes  as  a  result  of  separations,  retire¬ 
ments,  and  promotions  to  general  officer  in  later  years.  The  starting 
point  for  Navy  SWOs  was  the  first  year  of  service;  for  Air  Force  pilots 
the  starting  point  was  the  twelfth  YOS,  which  we  chose  because  the 
pilot  community  has  a  large  inflow  of  officers  after  year  1 .  The  sum  of 
the  number  of  officers  in  a  cohort  each  year  equals  the  total  man-years 
served  by  a  cohort  through  30  YOS.1  With  parameters  based  only  on 
historical  data,  this  number  represents  our  baseline  forecast  absent  any 
policy  changes. 

By  making  various  changes  to  the  cohort  profile,  we  calculated  a 
range  of  estimates  for  increased  total  man-years  resulting  from  the  pro¬ 
posed  programs.  We  calculated  ranges  because  we  do  not  know  what 

1  As  a  scaled-down  example,  if  100  officers  serve  in  Year  1  and  75  stay  to  serve  in  Year  2,  50 
stay  to  serve  in  Year  3,  and  25  stay  to  serve  in  Year  4  before  retiring,  the  total  man-years  served 
by  the  cohort  is  100  +  75  +  50  +  25  =  250  years. 
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the  participating  officers  would  have  done  if  the  programs  were  not  in 
place.  If  it  turns  out  that  the  officers  selected  to  participate  would  have 
served  long  careers  anyway,  the  programs  will  have  a  negligible  effect. 
If,  on  the  other  hand,  the  officers  selected  to  participate  would  have 
soon  left  the  communities,  the  program  effect  will  be  much  larger.  A 
middle-ground  estimate  assumes  that  the  participating  officers  would 
be  similar  to  the  rest  of  their  cohort  with  respect  to  continuation  rates, 
that  is,  some  would  leave  soon,  some  serve  a  few  more  years,  and  some 
serve  as  long  as  possible.  The  actual  effect  will  probably  be  somewhat 
larger  than  the  middle-ground  estimate  because  continuation  rates  for 
an  entire  cohort  include  those  officers  who  are  highly  competitive  for 
promotion,  and  who,  therefore,  might  be  more  likely  to  stay  than  offi¬ 
cers  who  do  not  screen  for  XO  or  who  are  not  selected  for  in-residence 
service  school. 

For  the  Navy  program,  we  assumed  that  with  the  program  in 
place  all  participants  would  continue  to  24  years.  To  estimate  the  net 
effect  of  the  program,  our  assumptions  are  as  follows:  For  the  low  esti¬ 
mate,  all  participants  would  have  served  to  24  years  even  without  the 
program.  For  the  middle  estimate,  the  ten  SWOs  chosen  after  the  third 
XO  screen  otherwise  would  have  had  continuation  rates  similar  to  the 
entire  community  until  20  years,  when  we  assume  all  retire.  For  the 
high  estimate,  the  ten  SWOs  chosen  after  the  third  XO  screen  other¬ 
wise  would  have  left  the  service  immediately  and  the  five  chosen  at  20 
years  would  otherwise  have  retired  at  that  point. 

For  the  Air  Force  program,  we  assumed  that  with  the  program  in 
place,  all  participants  would  continue  to  30  years.  To  estimate  the  net 
effect  of  the  program,  our  assumptions  are  as  follows:  For  the  low  esti¬ 
mate,  all  0-4s  would  have  served  to  24  years  and  all  0-5s  would  have 
served  to  28  years  even  without  the  program.  For  the  middle  estimate, 
participants  otherwise  would  have  had  continuation  rates  similar  to  the 
entire  community,  until  20  years  when  we  assume  all  remaining  0-4s 
retire  or  24  years  when  we  assume  all  remaining  0-5s  retire.  For  the 
high  estimate,  0-4s  and  0-5s  otherwise  would  have  left  the  service  at 
13  and  17  YOS,  respectively. 

There  are  several  Air  Force  occupations  that  typically  have  effec¬ 
tive  manning  shortages,  but  they  have  different  career  patterns,  pro- 
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motion  opportunities,  and  so  forth,  which  makes  modeling  the  effects 
of  a  single  program  difficult.  We  focus  our  analysis  on  pilots  because 
they  are  expected  to  have  effective  manning  shortages  for  years  to  come 
and  are  the  largest  of  the  occupations  that  would  likely  be  affected. 
Of  the  five  occupations  identified  with  large  effective  manning  short¬ 
ages — pilots,  development  engineers,  scientists,  manpower,  and  public 
affairs — pilots  represent  about  75  percent  of  the  total,  so  we  assume 
that  about  20  of  the  25  0-4s  and  15  of  the  20  0-5s  selected  for  par¬ 
ticipation  will  be  pilots. 
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Table  E.1 

Impact  on  Navy  Surface  Warfare  Community 


Participant  Career  Pattern 

Yr  _t0_  Without  Program 

Yr. 


Contin. 

Cohort 

Low 

Middle 

High 

YOS 

% 

Size 

Participants 

Estimate 

Estimate 

Estimate 

1 

100 

900.0 

2 

100 

900.0 

3 

100 

900.0 

4 

92 

829.4 

5 

83 

689.5 

6 

79 

544.4 

7 

78 

426.5 

8 

72 

307.4 

9 

77 

235.7 

10 

86 

203.1 

11 

90 

181.8 

12 

86 

156.3 

13 

85 

132.3 

14 

90 

119.0 

15 

93 

110.1 

10.0 

10.0 

10.0 

0.0 

16 

90 

98.7 

10.0 

10.0 

8.5 

0.0 

17 

91 

90.0 

10.0 

10.0 

7.6 

0.0 

18 

100 

90.0 

10.0 

10.0 

7.0 

0.0 

19 

100 

90.0 

10.0 

10.0 

6.3 

0.0 

20 

-  100 

90.0 

10.0 

10.0 

5.8 

0.0 

21 

50 

45.0 

15.0 

15.0 

0.0 

0.0 

22 

90 

40.5 

15.0 

15.0 

0.0 

0.0 

23 

89 

36.0 

15.0 

15.0 

0.0 

0.0 

24 

90 

32.4 

15.0 

15.0 

0.0 

0.0 

Total  man-years 

7248.2 

120.0 

120.0 

45.2 

0.0 

0.0 

74.8 

120.0 

Net  increase  in  man-years 

(difference  from  column  4) 
Percent  increase  in  man-years 


0.0%  1.0%  1.7% 


(percent  of  column  3) 
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Table  E.2 

Impact  on  Air  Force  Pilot  Community 


Yr.-to-Yr. 

contin. 

(%) 


Cohort 

Size 


Participants 


Participant  Career  Pattern 
Without  Program 
Low  Middle  High 

Estimate  Estimate  Estimate 


12 

13 

88 

600.0 

530.9 

20.0 

20.0 

20.0 

0.0 

14 

89 

471.2 

20.0 

20.0 

17.8 

0.0 

15 

92 

435.7 

20.0 

20.0 

16.4 

0.0 

16 

100 

435.7 

20.0 

20.0 

16.4 

0.0 

17 

97 

422.0 

35.0 

35.0 

30.9 

0.0 

18 

94 

398.4 

35.0 

35.0 

28.3 

0.0 

19 

94 

372.5 

35.0 

35.0 

26.3 

0.0 

20 

92 

343.8 

35.0 

35.0 

25.3 

0.0 

21 

68 

234.3 

35.0 

35.0 

11.9 

0.0 

22 

70 

165.2 

35.0 

35.0 

11.3 

0.0 

23 

74 

121.7 

35.0 

35.0 

10.5 

0.0 

24 

76 

92.2 

35.0 

35.0 

9.7 

0.0 

25 

82 

75.5 

35.0 

15.0 

0.0 

0.0 

26 

86 

65.0 

35.0 

15.0 

0.0 

0.0 

27 

73 

47.4 

35.0 

15.0 

0.0 

0.0 

28 

69 

32.8 

35.0 

15.0 

0.0 

0.0 

29 

59 

19.3 

35.0 

0.0 

0.0 

0.0 

30 

85 

16.4 

35.0 

0.0 

0.0 

0.0 

Total  man-years 

4880.6 

570.0 

420.0 

224.8 

0.0 

Net  increase  in  man-years 
(difference  from  column  4) 

150.0 

345.2 

570.0 

Percent,  increase  in  man-years  from  YOS  12  to  30 
(percent  of  column  3) 


3.1% 


7.1% 


11.7% 


Bibliography 


The  Army  Training  and  Leader  Development  Panel  Officer  Study  Report  to  the 
Army,  Washington,  D.C.,  May  2001. 

Buddin,  Richard.  2  +  2  +  4  Recruiting  Program:  Preliminary  Enlistment  Re¬ 
sults,  Santa  Monica,  Calif.:  RAND  Corporation,  WD-5205-A,  November 
1990. 

- ,  Enlistment  Effects  of  the  2  +  2+4  Recruiting  Experiment,  Santa  Mon¬ 
ica,  Calif:  RAND  Corporation,  R-4097-A,  1991. 

Buddin,  Richard,  and  J.  Michael  Polich,  The  2  +  2  +  4  Recruiting  Experiment: 
Design  and  Initial  Results,  Santa  Monica,  Calif:  RAND  Corporation,  N- 
3187-A,  1990. 

Civilian  Acquisition  Workforce  Personnel  Demonstration  Project;  Depart¬ 
ment  of  Defense;  Notice,  Federal  Register,  Vol.  64,  No.  5,  January  8,  1999, 
pp.  1425-1492. 

Cook,  T.  D.,  and  D.  T.  Campbell,  Quasi-experimentation:  Design  and  Analysis 
for  Field  Settings,  Chicago:  Rand  McNally,  1979. 

Cook,  T.  D.,  D.  T.  Campbell,  and  L.  Peracchio,  “Quasi  Experimentation,” 
in  M.  D.  Dunnette  and  L.  M.  Hough,  eds.,  Handbook  of  Industrial  and 
Organizational  Psychology.  Vol.  1,  Palo  Alto,  Calif:  Consulting  Psycholo¬ 
gists  Press,  Inc.,  1990. 

Defense  Manpower  Commission,  Defense  Manpower:  The  Keystone  of  Na¬ 
tional  Security,  Report  to  the  President  and  the  Congress,  Washington,  D.C., 
March  1976. 

Dillender,  Mike,  Marshall  Pattie,  Allison  Rohrer,  and  Angela  Shaw,  “Give  Of¬ 
ficers  a  New  Option,”  Navy  Proceedings,  October  2002,  pp.  46-47. 


91 


92  New  Paths  to  Success 


Fernandez,  Richard,  Enlistment  Effects  and  Policy  Implications  of  the  Educa¬ 
tional  Assistance  Test  Program,  Santa  Monica,  Calif.:  RAND  Corporation, 
R-2935-MRAL,  1982. 

Haggstrom,  G.  W.,  Thomas  J.  Blaschke,  Winston  K.  Chow,  and  William 
Lisowski,  The  Multiple  Option  Recruiting  Experiment,  Santa  Monica,  Ca¬ 
lif:  RAND  Corporation,  R-2671-MRAL,  1981. 

Jumper,  John  (Air  Force  Chief  of  Staff),  “Chief’s  Sight  Picture,”  November 

6,  2002. 

Laboratory  Personnel  Management  Demonstration  Project;  Department  of 
the  Air  Force;  Notice,  Federal  Register,  Vol.  61,  No.  230,  November  27, 
1996,  pp.  60399-60424. 

Laboratory  Personnel  Management  Demonstration  Project;  Department  of 
the  Army,  U.S.  Medical  Research  and  Materiel  Command,  Fort  Detrick, 
Frederick,  Md.;  Notice,  Federal  Register,  Vol.  63,  No.  41,  March  3,  1998, 
pp.  10439-10462. 

Maze,  Rick,  “Rumsfeld  Broaches  Changes  in  Career  Structures,”  Army  Times, 
February  3,  2003,  p.  12. 

Naval  Personnel  Task  Force,  A  Strategic  Human  Resource  Management  System 
for  the  21st  Century :  Vol.  I,  Washington,  D.C.,  September  2000. 

Naval  Sea  Systems  Command  Warfare  Centers  Demonstration  Project  Web 
site,  http://www.nswc.navy.mi1/P/DEMO/  (as  of  June  3,  2003). 

Orvis,  Bruce  R.,  James  R.  Hosek,  and  Michael  G.  Mattock,  PACER  SHARE: 
Productivity  and  Personnel  Management  Demonstration  Baseline  Evaluation, 
Santa  Monica,  Calif:  RAND  Corporation,  R-3733-FMP,  1990. 

- ,  PACER  SHARE:  Productivity  and  Personnel  Management  Demonstra¬ 
tion,  Third  Year  Evaluation,  Santa  Monica,  Calif:  RAND  Corporation, 
MR-310-P&R,  1993. 

Pogue,  Forrest  C.,  George  C.  Marshall:  Ordeal  and  Hope,  New  York:  Viking 
Press,  1966. 

Polich,  J.  Michael,  and  R.  Buddin,  2  +  2+4  Recruiting  Program:  Test  Design, 
Santa  Monica,  Calif:  RAND  Corporation,  WD-4319-A,  March  1989. 

Polich,  J.  Michael,  James  N.  Dertouzos,  and  S.  James  Press,  The  Enlistment 
Bonus  Experiment,  Santa  Monica,  Calif:  RAND  Corporation,  R-3353- 
FMP,  1986. 


Bibliography  93 


Research  and  Demonstration  Branch,  Office  of  Performance  Management, 
Office  of  Personnel  Management,  Evaluation  of  the  Navy  Personnel  Man¬ 
agement  Demonstration  Project:  Analysis  of  Survey  and  Interview  Results 
1979-1983,  Management  Report  II,  July  1984. 

Rossi,  Peter  H.,  Howard  E.  Freeman,  and  Mark  W.  Lipsey,  Evaluation:  A  Sys¬ 
tematic  Approach,  Thousand  Oaks,  Calif.:  Sage  Publications,  1999. 

Schmitt,  Nicholas  J.,  “The  ‘Up-or-Out’  Policy,”  Navy  Proceedings,  December 
1979,  pp.  35-40. 

Science  and  Technology  Reinvention  Laboratory  Personnel  Demonstration 
Project  at  the  Aviation  Research,  Development,  and  Engineering  Center; 
Notice,  Federal  Register,  Vol.  62,  No.  124,  June  27,  1997,  pp.  34905- 
34932. 

Science  and  Technology  Reinvention  Laboratory  Personnel  Demonstration 
Project  at  the  Missile  Research,  Development,  and  Engineering  Center 
(MRDEC);  Notice,  Federal  Register,  Vol.  62,  No.  124,  June  27,  1997,  pp. 
34875-34903. 

Science  and  Technology  Reinvention  Laboratory  Personnel  Demonstration 
Project  at  the  U.S.  Army  Research  Laboratory  (ARL);  Notice,  Federal  Reg¬ 
ister,  Vol.  63,  No.  42,  March  4,  1998,  pp.  10679-1071 1. 

Science  and  Technology  Reinvention  Laboratory  Personnel  Demonstration 
Project  Final  Plan:  U.S.  Army  Engineer  Waterways  Experiment  Station 
(WES),  Vicksburg,  Miss.;  Notice;  Republication,  Federal  Register,  Vol.  63, 
No.  57,  March  25,  1998,  pp.  14579-14599. 

Surface  Warfare  Officer  Junior  Officer  Survey,  1999  and  2001. 

United  States  Code,  Title  5,  Section  4703,  Demonstration  Projects. 

- ,  Title  5,  Section  9507,  Streamlined  Demonstration  Project  Authority. 

- ,  Title  10,  Section  523,  Authorized  Strengths. 

- ,  Title  10,  Section  611,  Convening  of  Selection  Boards. 

- ,  Title  10,  Section  627,  Failure  of  Selection  for  Promotion. 

- ,  Title  10,  Section  632,  Effect  of  Failure  of  Selection  for  Promotion. 

- ,  Title  10,  Section  633,  Retirement  for  Years  of  Service:  Regular  Lieu¬ 
tenant  Colonels  and  Commanders. 

- ,  Title  10,  Section  634,  Retirement  for  Years  of  Service:  Regular  Colo¬ 
nels  and  Captains. 


94  New  Paths  to  Success 


- ,  Title  10,  Section  1251,  Age  62:  Regular  Commissioned  Officers; 

Exceptions  [for  retirement  for  age] . 

- ,  Title  10,  Section  1370,  Commissioned  Officers:  General  Rule;  Ex¬ 
ceptions  [for  retired  grade] . 

- ,  Title  10,  Section  3962,  Higher  Grade  for  Service  in  Special  Posi¬ 
tions. 

The  U.S.  Commission  on  National  Security/2 1st  Century,  Road  Map  for  Na¬ 
tional  Security:  Imperative  for  Change,  February  2001. 

U.S.  Naval  Research  Laboratory  (NRL)  Personnel  Management  Demonstra¬ 
tion  Project;  Department  of  the  Navy  (DON),  Washington  D.C.;  Notice, 
Federal  Register,  Vol.  64,  No.  121,  June  24,  1999,  pp.  33969-34046. 

U.S.  Office  of  Personnel  Management  Demonstration  Projects  Evaluation 
Handbook,  www.opm.gov/demos/resources.asp  (as  of  April  1,  1999). 

U.S.  Senate,  Committee  on  Armed  Services,  Officer  Personnel  Act  of  1947, 
Hearings  80th  Congress,  1st  Session,  July  16,  1947. 

Vandergriff,  Donald,  The  Path  to  Victory:  Americas  Army  and  the  Revolution  in 
Human  Affairs,  Novato,  Calif.:  Presidio  Press,  2002. 


